-- Logs begin at Tue 2021-05-25 15:59:12 UTC, end at Tue 2021-05-25 16:55:33 UTC. --
May 25 16:29:15.471078 dv-cinder-786386-6-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
May 25 16:29:16.457832 dv-cinder-786386-6-iscsi neutron-server[91907]: Beware of the coming changes in the project packaging
May 25 16:29:16.458467 dv-cinder-786386-6-iscsi neutron-server[91907]: https://github.com/svinota/pyroute2/discussions/786
May 25 16:29:17.930965 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.common.config [-] Logging enabled!
May 25 16:29:17.931601 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240
May 25 16:29:17.931720 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91907) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 25 16:29:17.934924 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.common.config [-] Logging enabled!
May 25 16:29:17.935181 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240
May 25 16:29:17.935492 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91907) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 25 16:29:17.936418 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 25 16:29:17.936652 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 25 16:29:17.937003 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 25 16:29:17.937246 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 25 16:29:17.937501 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 25 16:29:17.937821 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.938114 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.938407 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.938633 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.938924 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.939212 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.939492 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.939798 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.940100 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.940389 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.940661 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.940943 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.941171 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.941473 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.941759 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.942042 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.942265 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] debug                          = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.942542 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.942966 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.943375 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.943652 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.943940 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.944216 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.944486 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.944761 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.945041 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.945365 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] host                           = dv-cinder-786386-6-iscsi {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.945666 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.945953 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.946236 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.946521 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.946796 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.947068 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.947348 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.947618 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.947889 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.948159 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.948449 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.948737 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.949027 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.949251 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.949503 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.949797 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.950081 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.950355 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.950628 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.950902 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.951175 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.951448 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.951714 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.951996 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.952277 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.952560 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.952833 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.953104 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.953379 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.953681 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.953961 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.954232 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.954504 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.954776 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.955060 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.955329 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.955622 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.955919 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.956202 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.956483 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.956764 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.957038 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.957317 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.957609 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.957881 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.958151 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.958421 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.958690 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.958969 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.959239 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.959508 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.959782 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.960049 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.960328 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:17.960624 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.960919 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.961218 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.961534 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.961830 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.962108 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.962396 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.962674 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.962962 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.963248 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.963534 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.963813 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.964100 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.964377 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.964672 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.964974 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.965266 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.965581 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.965857 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.966130 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.966403 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.966682 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.966967 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.967259 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.967548 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.967821 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.968099 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.968388 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.968667 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.968940 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.969219 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.969534 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.969820 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.970091 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.970370 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.970646 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.970916 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.971756 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.971980 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.972270 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.972547 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.972817 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.973089 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.973371 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.973669 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.973952 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.974226 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.974497 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.974769 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.975048 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.975320 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.975592 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.975869 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.976140 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.976418 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.976687 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.976957 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.977228 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.977525 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.977796 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.978067 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.978336 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.978611 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.978880 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.979154 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.979425 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.979702 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.979973 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.980257 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.980551 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.980827 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.981104 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.981383 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.981682 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.981958 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.982233 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.982508 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.982786 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.983057 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.983347 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.983629 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.983914 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.984195 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.984469 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.984760 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.985038 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.985320 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.985620 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.985898 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.986187 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.986470 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.986810 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.987613 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.987906 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.988199 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.988489 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.988768 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.989075 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.989351 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:17.989589 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 25 16:29:17.989832 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=91907) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
May 25 16:29:18.363077 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=91907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:29:18.363351 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=91907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:29:18.363642 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=91907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:29:18.364135 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.manager [-] Loading core plugin: ml2
May 25 16:29:18.751770 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.751979 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.752250 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.754000 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.754270 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.754531 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.789552 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.789823 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.790089 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.803343 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.803621 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.803887 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.834111 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.834387 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.834652 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.870325 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.870596 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:18.870858 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.101984 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7f346cfaaee0> agent after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.102618 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7f346cfaaee0> agent after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.102618 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7f346cfaae50> segment precommit_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.102773 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7f346cfaadc0> network precommit_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.103428 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7f346cfce9d0> segment before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.226850 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> network before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.227091 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7f346cf400d0> agent before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.227306 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> network before_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.227586 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> port before_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.227859 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> port before_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.228170 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> segment precommit_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.228432 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> segment precommit_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.228691 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> segment after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.228949 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> segment after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.229233 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> network after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.229525 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> network precommit_delete 0 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.229795 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> port provisioning_complete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.230062 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> rbac-policy before_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.230319 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> rbac-policy after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.230588 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> agent after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.230860 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> subnet after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.232265 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> subnet precommit_delete 0 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.232564 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> rbac-policy before_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.232838 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> rbac-policy before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.233138 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> segment_host_mapping after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.233524 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> port after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.233799 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> port after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.234057 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> port after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.234351 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> rbac-policy before_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.234608 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> rbac-policy before_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.234860 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f346d8e8ca0>> rbac-policy before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.235252 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=91907) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 16:29:19.235499 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=91907) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 16:29:19.235737 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=91907) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 16:29:19.235973 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=91907) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 16:29:19.236211 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=91907) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 16:29:19.236448 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=91907) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 16:29:19.236853 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
May 25 16:29:19.240074 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
May 25 16:29:19.243955 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
May 25 16:29:19.247713 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(400, 449)])])
May 25 16:29:19.249343 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
May 25 16:29:19.249817 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
May 25 16:29:19.250153 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
May 25 16:29:19.250667 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
May 25 16:29:19.253563 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
May 25 16:29:19.253772 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
May 25 16:29:19.254119 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
May 25 16:29:19.281360 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
May 25 16:29:19.281846 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7f346d076a30>> qos_plugin after_init 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.282145 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=91907) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
May 25 16:29:19.282505 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7f346d0764c0>> logging-plugin after_init 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.284470 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=91907) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
May 25 16:29:19.284746 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
May 25 16:29:19.284990 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
May 25 16:29:19.288232 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7f346cf8f1f0>> floatingip before_response 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.288511 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7f346cf8f1f0>> port before_response 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.356477 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
May 25 16:29:19.356665 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
May 25 16:29:19.356901 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
May 25 16:29:19.357264 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
May 25 16:29:19.387118 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_db.sqlalchemy.engines [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
May 25 16:29:19.715701 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Initializing driver for type 'gre'
May 25 16:29:19.716370 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] gre ID ranges: [(1, 1000)]
May 25 16:29:19.767902 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Initializing driver for type 'local'
May 25 16:29:19.768332 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Initializing driver for type 'vlan'
May 25 16:29:19.779920 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] VlanTypeDriver initialization complete
May 25 16:29:19.780329 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Initializing driver for type 'vxlan'
May 25 16:29:19.780808 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] vxlan ID ranges: [(1, 1000)]
May 25 16:29:19.830769 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Initializing extension driver 'port_security'
May 25 16:29:19.831148 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.extensions.port_security [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] PortSecurityExtensionDriver initialization complete
May 25 16:29:19.831499 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Initializing mechanism driver 'openvswitch'
May 25 16:29:19.831837 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Initializing mechanism driver 'hyperv'
May 25 16:29:19.838426 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.plugins.ml2.plugin [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=91907) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:29:19.839199 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346cf004f0>> port after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.839574 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346cf004f0>> port after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.839931 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346cf004f0>> port after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.840316 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346cf00370>> subnet after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.840666 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346cf00370>> subnet after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.841010 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346cf00370>> subnet after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.841389 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346c96a3a0>> network after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.841756 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346c96a3a0>> network after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.842097 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346c96a3a0>> network after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.842469 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346c96a5b0>> security_group after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.842812 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346c96a5b0>> security_group after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.843149 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346c96a5b0>> security_group after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.843523 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346c96a820>> security_group_rule after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.843871 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346c96a820>> security_group_rule after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.844205 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346c96a820>> security_group_rule after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.844578 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346c96aa60>> address_group after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.844920 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346c96aa60>> address_group after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.845254 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f346c96aa60>> address_group after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.845616 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] ML2 OVO RPC backend initialized. {{(pid=91907) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
May 25 16:29:19.846325 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> router_interface after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.846677 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> router_interface after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.847092 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> network before_response 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.847434 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> networks before_response 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.847777 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> port before_response 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.848115 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> ports before_response 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.848453 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> subnet before_response 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.848790 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> subnets before_response 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.849133 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> network after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.849497 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> network after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.849832 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> network after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.850169 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> port after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.850504 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> port after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.850836 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> port after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.851168 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> subnet after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.851497 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> subnet after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.851828 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f346c96ae20>> subnet after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.852401 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.plugin [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Modular L2 Plugin initialization complete
May 25 16:29:19.852724 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading services supported by the core plugin {{(pid=91907) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
May 25 16:29:19.853056 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.plugins.ml2.managers [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Got port-security extension from driver 'port_security'
May 25 16:29:19.853550 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.extensions.vlantransparent [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Disabled vlantransparent extension.
May 25 16:29:19.854051 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=91907) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
May 25 16:29:19.854365 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading Plugin: router
May 25 16:29:19.892131 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router_interface before_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.892524 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router after_create 55549900 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.892919 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router before_create 55549900 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.893290 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router_interface before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.893686 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router_interface after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.894038 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router after_delete 55549900 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.894396 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> floatingip after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.894758 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router after_create 55549900 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.895106 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router after_update 55549900 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.895457 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router after_update 55549900 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.895808 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router_gateway after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.896169 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router after_update 55549900 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.896576 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router precommit_update 55549900 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.896946 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7f346cec0940> port after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.897284 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7f346cec0a60> port after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.897651 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7f346cec09d0> subnet after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.897985 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7f346cec0820> subnetpool_address_scope after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.898352 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> port precommit_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.898680 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router precommit_create 55549900 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.899027 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7f346ceb6430> port before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.899368 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router precommit_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.899723 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router after_update 55549900 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.900064 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router precommit_delete 55549900 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.900408 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router precommit_create 55549900 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.900769 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router_interface after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.901111 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> router precommit_update 55549900 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.901519 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f346c96af40>> network after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.902372 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Tracking information for resource: router configured {{(pid=91907) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 16:29:19.902704 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Tracking information for resource: floatingip configured {{(pid=91907) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 16:29:19.907621 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.db.l3_agentschedulers_db [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
May 25 16:29:19.908203 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <function _notify_l3_agent_port_update at 0x7f346c8e0e50> port after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.908590 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <function _notify_l3_agent_new_port at 0x7f346c8e0d30> port after_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.908942 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <function _notify_port_delete at 0x7f346c8e0dc0> port after_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.909296 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7f346c8e6160> port after_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.910116 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f346c90a760>> router before_create 55550100 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.910483 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f346c90a760>> router precommit_delete 55550100 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.910843 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f346c90a760>> router precommit_create 55550100 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.911198 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f346c90a760>> router precommit_update 55550100 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.915667 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.services.provider_configuration [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service providers = [] {{(pid=91907) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
May 25 16:29:19.916031 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.db.servicetype_db [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=91907) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
May 25 16:29:19.918945 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.services.service_base [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=91907) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 25 16:29:19.919298 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.services.service_base [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=91907) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 25 16:29:19.919640 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.services.service_base [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=91907) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 25 16:29:19.920528 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.services.service_base [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=91907) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 25 16:29:19.920899 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.services.service_base [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Default provider is not specified for service type L3_ROUTER_NAT
May 25 16:29:19.921461 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=91907) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 16:29:19.921782 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
May 25 16:29:19.933004 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=91907) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 16:29:19.933343 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading Plugin: auto_allocate
May 25 16:29:19.938986 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7f346c92f550> network precommit_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.939348 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7f346c92f550> network precommit_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.940506 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=91907) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 16:29:19.940826 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading Plugin: tag
May 25 16:29:19.947612 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=91907) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 16:29:19.948001 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading Plugin: timestamp
May 25 16:29:19.951709 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=91907) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 16:29:19.952042 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading Plugin: network_ip_availability
May 25 16:29:19.957586 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f346c922dc0>> rbac-policy before_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.957956 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f346c922dc0>> rbac-policy before_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.958315 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f346c922dc0>> rbac-policy before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:19.959994 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=91907) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 16:29:19.960316 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading Plugin: flavors
May 25 16:29:19.965196 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=91907) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 16:29:19.965568 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading Plugin: revisions
May 25 16:29:19.969898 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=91907) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 16:29:19.970238 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_concurrency.lockutils [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.606s {{(pid=91907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:29:19.970967 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=91907) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
May 25 16:29:19.971320 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Initializing extension manager.
May 25 16:29:19.971818 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: __init__.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.972155 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: __pycache__ {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.972483 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.972812 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: address_group.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.973591 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.974155 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: address-group
May 25 16:29:19.974475 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: address_scope.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.975177 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.975680 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: address-scope
May 25 16:29:19.975999 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: admin_state_down_before_update.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.976913 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.977452 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: router-admin-state-down-before-update
May 25 16:29:19.977779 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: agent.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.978477 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.978985 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: agent
May 25 16:29:19.979304 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: agent_resources_synced.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.980267 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.980775 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: agent-resources-synced
May 25 16:29:19.981093 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: allowedaddresspairs.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.982894 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.983404 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: allowed-address-pairs
May 25 16:29:19.983731 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: auto_allocated_topology.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.984793 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.985309 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: auto-allocated-topology
May 25 16:29:19.985665 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: availability_zone.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.986355 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.987378 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: availability_zone
May 25 16:29:19.987701 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: availability_zone_filter.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.988605 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.989115 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: availability_zone_filter
May 25 16:29:19.989462 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: data_plane_status.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.990363 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.990860 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension data-plane-status not supported by any of loaded plugins
May 25 16:29:19.991178 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: default_subnetpools.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.992080 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.992583 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: default-subnetpools
May 25 16:29:19.992902 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: dhcpagentscheduler.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.993737 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.994241 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: dhcp_agent_scheduler
May 25 16:29:19.994559 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: dns.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.995461 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.995962 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension dns-integration not supported by any of loaded plugins
May 25 16:29:19.996281 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: dns_domain_ports.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.997182 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.997711 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension dns-domain-ports not supported by any of loaded plugins
May 25 16:29:19.998033 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: dvr.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:19.998699 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:19.999204 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: dvr
May 25 16:29:19.999525 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: empty_string_filtering.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.000427 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.000936 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: empty-string-filtering
May 25 16:29:20.001253 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.002181 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.003273 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
May 25 16:29:20.003546 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.004458 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.004963 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
May 25 16:29:20.005278 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: external_net.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.006206 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.006717 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: external-net
May 25 16:29:20.007034 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: extra_dhcp_opt.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.007925 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.008433 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: extra_dhcp_opt
May 25 16:29:20.008749 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: extraroute.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.009662 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.010171 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: extraroute
May 25 16:29:20.010486 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: extraroute_atomic.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.011502 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.012007 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: extraroute-atomic
May 25 16:29:20.012327 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: filter_validation.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.012978 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.013513 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: filter-validation
May 25 16:29:20.013833 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: fip_pf_description.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.014901 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.015405 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
May 25 16:29:20.015726 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: fip_port_details.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.016626 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.017134 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: fip-port-details
May 25 16:29:20.017489 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: flavors.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.019247 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.019764 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: flavors
May 25 16:29:20.020188 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.022499 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.023269 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
May 25 16:29:20.023824 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: floatingip_pools.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.024940 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.025706 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: floatingip-pools
May 25 16:29:20.026174 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: ip_allocation.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.027633 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.028491 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension ip_allocation not supported by any of loaded plugins
May 25 16:29:20.029049 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.030572 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.031475 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: ip-substring-filtering
May 25 16:29:20.032049 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: l2_adjacency.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.034230 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.035139 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension l2_adjacency not supported by any of loaded plugins
May 25 16:29:20.035710 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: l3.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.037358 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.038322 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: router
May 25 16:29:20.038888 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: l3_conntrack_helper.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.042594 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.043269 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
May 25 16:29:20.043806 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.044790 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.045314 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: ext-gw-mode
May 25 16:29:20.045668 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.046582 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.047097 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: l3-ha
May 25 16:29:20.047423 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: l3_flavors.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.048331 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.048841 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: l3-flavors
May 25 16:29:20.049287 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.050259 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.050767 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: l3-port-ip-change-not-allowed
May 25 16:29:20.051344 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: l3agentscheduler.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.052396 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.052907 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: l3_agent_scheduler
May 25 16:29:20.053232 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: logging.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.054784 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.055304 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension logging not supported by any of loaded plugins
May 25 16:29:20.055631 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: metering.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.056366 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.056942 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: metering
May 25 16:29:20.057265 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.058379 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.058894 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: metering_source_and_destination_fields
May 25 16:29:20.059214 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: multiprovidernet.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.060279 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.060792 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: multi-provider
May 25 16:29:20.061113 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: netmtu.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.062046 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.062554 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: net-mtu
May 25 16:29:20.062873 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: netmtu_writable.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.063779 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.064282 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: net-mtu-writable
May 25 16:29:20.064628 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: network_availability_zone.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.065370 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.065852 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: network_availability_zone
May 25 16:29:20.066166 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: network_ip_availability.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.067251 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.067762 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: network-ip-availability
May 25 16:29:20.068082 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: network_segment_range.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.068836 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.069335 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension network-segment-range not supported by any of loaded plugins
May 25 16:29:20.069679 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: pagination.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.070663 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.070991 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: pagination
May 25 16:29:20.071306 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: port_device_profile.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.072193 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.072707 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: port-device-profile
May 25 16:29:20.073024 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.073970 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.074482 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: port-mac-address-regenerate
May 25 16:29:20.074800 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.075693 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.076201 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: port-numa-affinity-policy
May 25 16:29:20.076518 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: port_resource_request.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.077450 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.077957 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension port-resource-request not supported by any of loaded plugins
May 25 16:29:20.078278 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: portbindings.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.079193 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.079700 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: binding
May 25 16:29:20.080021 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: portbindings_extended.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.082042 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.082516 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: binding-extended
May 25 16:29:20.082665 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: portsecurity.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.083589 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.084085 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: port-security
May 25 16:29:20.084403 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: project_id.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.085364 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.085728 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: project-id
May 25 16:29:20.086048 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: providernet.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.086962 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.087473 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: provider
May 25 16:29:20.087790 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: qos.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.091283 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.091805 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension qos not supported by any of loaded plugins
May 25 16:29:20.092138 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.093376 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.093912 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
May 25 16:29:20.094240 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.095154 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.095668 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
May 25 16:29:20.096009 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: qos_default.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.097459 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.097974 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension qos-default not supported by any of loaded plugins
May 25 16:29:20.098300 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: qos_fip.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.098942 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.099444 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension qos-fip not supported by any of loaded plugins
May 25 16:29:20.099765 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: qos_gateway_ip.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.100679 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.101183 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension qos-gateway-ip not supported by any of loaded plugins
May 25 16:29:20.101533 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: qos_port_network_policy.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.102438 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.102969 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension qos-port-network-policy not supported by any of loaded plugins
May 25 16:29:20.103250 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: qos_rule_type_details.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.104159 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.104689 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension qos-rule-type-details not supported by any of loaded plugins
May 25 16:29:20.105011 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: qos_rules_alias.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.106079 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.106591 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension qos-rules-alias not supported by any of loaded plugins
May 25 16:29:20.107198 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: quotasv2.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.108217 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.108542 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: quotas
May 25 16:29:20.108859 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: quotasv2_detail.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.110491 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.110830 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: quota_details
May 25 16:29:20.111161 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: rbac.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.112237 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.112756 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: rbac-policies
May 25 16:29:20.113084 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: rbac_address_group.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.114047 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.114750 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: rbac-address-group
May 25 16:29:20.114892 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: rbac_address_scope.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.115797 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.116309 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: rbac-address-scope
May 25 16:29:20.116632 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: rbac_security_groups.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.117575 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.118085 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: rbac-security-groups
May 25 16:29:20.118409 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: rbac_subnetpool.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.119322 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.119830 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: rbac-subnetpool
May 25 16:29:20.120152 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: revisionifmatch.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.121051 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.121589 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: revision-if-match
May 25 16:29:20.121910 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: revisions.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.123008 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.123528 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: standard-attr-revisions
May 25 16:29:20.123853 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: router_availability_zone.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.124519 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.125031 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: router_availability_zone
May 25 16:29:20.125355 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: routerservicetype.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.126303 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.126816 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension router-service-type not supported by any of loaded plugins
May 25 16:29:20.127138 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.128560 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.129076 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: security-groups-normalized-cidr
May 25 16:29:20.129418 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: security_groups_port_filtering.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.130331 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.130837 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: port-security-groups-filtering
May 25 16:29:20.131157 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.132068 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.132580 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: security-groups-remote-address-group
May 25 16:29:20.132900 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: securitygroup.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.142492 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.143611 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: security-group
May 25 16:29:20.143951 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: segment.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.144735 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.145248 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension segment not supported by any of loaded plugins
May 25 16:29:20.145678 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.146618 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.147132 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
May 25 16:29:20.147457 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: servicetype.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.148564 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.149083 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: service-type
May 25 16:29:20.149419 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: sorting.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.150404 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.150735 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: sorting
May 25 16:29:20.151059 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: standard_attr_segment.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.151974 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.152487 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension standard-attr-segment not supported by any of loaded plugins
May 25 16:29:20.152812 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: standardattrdescription.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.153483 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.153998 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: standard-attr-description
May 25 16:29:20.154318 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: stateful_security_group.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.155230 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.155740 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: stateful-security-group
May 25 16:29:20.156060 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: stdattrs_common.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.156626 dv-cinder-786386-6-iscsi neutron-server[91907]: WARNING neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
May 25 16:29:20.156942 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.157957 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.158462 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
May 25 16:29:20.158804 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: subnet_onboard.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.159873 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.160387 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: subnet_onboard
May 25 16:29:20.160705 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.162585 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.162585 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
May 25 16:29:20.162585 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: subnet_service_types.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.163396 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.163916 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: subnet-service-types
May 25 16:29:20.164238 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: subnetallocation.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.165323 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.165866 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: subnet_allocation
May 25 16:29:20.166188 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.166844 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.167353 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: subnetpool-prefix-ops
May 25 16:29:20.167672 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.168590 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.169096 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
May 25 16:29:20.169431 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: tagging.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.170510 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.171024 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: standard-attr-tag
May 25 16:29:20.171347 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: timestamp.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.172548 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.173065 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loaded extension: standard-attr-timestamp
May 25 16:29:20.173388 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: trunk.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.174482 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.175003 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension trunk not supported by any of loaded plugins
May 25 16:29:20.175330 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: trunk_details.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.176493 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.177004 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension trunk-details not supported by any of loaded plugins
May 25 16:29:20.177327 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: uplink_status_propagation.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.178274 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.178781 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension uplink-status-propagation not supported by any of loaded plugins
May 25 16:29:20.179102 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Loading extension file: vlantransparent.py {{(pid=91907) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 16:29:20.179768 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=91907) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 16:29:20.180275 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extension vlan-transparent not supported by any of loaded plugins
May 25 16:29:20.182801 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:network
May 25 16:29:20.183555 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:subnet
May 25 16:29:20.185471 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:subnetpool
May 25 16:29:20.186111 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:port
May 25 16:29:20.187389 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.187827 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service FLAVORS assigned prefix:  {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.188462 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.188893 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.189224 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:router
May 25 16:29:20.190464 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:floatingip
May 25 16:29:20.191169 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service METERING assigned prefix: /metering {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.192615 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f346c805310>> rbac-policy before_create 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:20.192982 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f346c805310>> rbac-policy before_update 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:20.193335 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f346c805310>> rbac-policy before_delete 55550000 {{(pid=91907) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:29:20.194508 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of CountableResource for resource:rbac_policy
May 25 16:29:20.194967 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:security_group
May 25 16:29:20.195648 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:security_group_rule
May 25 16:29:20.196385 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service CORE assigned prefix:  {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.196713 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:subnetpool
May 25 16:29:20.197047 dv-cinder-786386-6-iscsi neutron-server[91907]: WARNING neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] subnetpool is already registered
May 25 16:29:20.197686 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service CORE assigned prefix:  {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.198014 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:subnetpool
May 25 16:29:20.198348 dv-cinder-786386-6-iscsi neutron-server[91907]: WARNING neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] subnetpool is already registered
May 25 16:29:20.200924 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.201362 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service FLAVORS assigned prefix:  {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.201977 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.202398 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.202728 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:router
May 25 16:29:20.203058 dv-cinder-786386-6-iscsi neutron-server[91907]: WARNING neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] router is already registered
May 25 16:29:20.203655 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:floatingip
May 25 16:29:20.203985 dv-cinder-786386-6-iscsi neutron-server[91907]: WARNING neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] floatingip is already registered
May 25 16:29:20.204618 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service METERING assigned prefix: /metering {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.205296 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of CountableResource for resource:rbac_policy
May 25 16:29:20.206253 dv-cinder-786386-6-iscsi neutron-server[91907]: WARNING neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] rbac_policy is already registered
May 25 16:29:20.206751 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:security_group
May 25 16:29:20.207080 dv-cinder-786386-6-iscsi neutron-server[91907]: WARNING neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] security_group is already registered
May 25 16:29:20.207689 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:security_group_rule
May 25 16:29:20.208028 dv-cinder-786386-6-iscsi neutron-server[91907]: WARNING neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] security_group_rule is already registered
May 25 16:29:20.208699 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service CORE assigned prefix:  {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.209028 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:subnetpool
May 25 16:29:20.209353 dv-cinder-786386-6-iscsi neutron-server[91907]: WARNING neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] subnetpool is already registered
May 25 16:29:20.209984 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.v2.resource_helper [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Service CORE assigned prefix:  {{(pid=91907) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 16:29:20.210306 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Creating instance of TrackedResource for resource:subnetpool
May 25 16:29:20.210626 dv-cinder-786386-6-iscsi neutron-server[91907]: WARNING neutron.quota.resource_registry [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] subnetpool is already registered
May 25 16:29:20.211272 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: extensions {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.212746 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: address-groups {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.214382 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: address-scopes {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.215581 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: agents {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.216707 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: auto-allocated-topology {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.217974 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: availability_zones {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.219261 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: dhcp-networks {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.220724 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: dhcp-agents {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.222148 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: routers {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.223916 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: flavors {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.225068 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: service_profiles {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.226304 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: next_providers {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.227807 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: service_profiles {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.229244 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: floatingip-pools {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.230473 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: routers {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.232255 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: floatingips {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.233458 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: l3-routers {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.234830 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: l3-agents {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.236196 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: metering-labels {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.237611 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: metering-label-rules {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.238882 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: network-ip-availabilities {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.240116 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: bindings {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.241857 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: quotas {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.243266 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: quotas {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.244662 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: rbac-policies {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.245978 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: security-groups {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.247181 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: security-group-rules {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.248404 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: service-providers {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.249622 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: subnetpools {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.251940 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: subnetpools {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.253965 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: tags {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.255670 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: tags {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.367711 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: tags {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.369596 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: tags {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.371358 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: tags {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.373248 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: tags {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.374945 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: tags {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.376860 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: tags {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.379158 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: tags {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.380998 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron.api.extensions [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Extended resource: tags {{(pid=91907) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 16:29:20.386820 dv-cinder-786386-6-iscsi neutron-server[91907]: WARNING keystonemiddleware.auth_token [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
May 25 16:29:20.391563 dv-cinder-786386-6-iscsi neutron-server[91907]: WARNING keystonemiddleware.auth_token [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
May 25 16:29:20.400424 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_concurrency.lockutils [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Acquired lock "singleton_lock" {{(pid=91907) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
May 25 16:29:20.400913 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_concurrency.lockutils [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Releasing lock "singleton_lock" {{(pid=91907) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
May 25 16:29:20.401649 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO oslo_service.service [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Starting 2 workers
May 25 16:29:20.406518 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Started child 92012 {{(pid=91907) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 25 16:29:20.411126 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Started child 92013 {{(pid=91907) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 25 16:29:20.412016 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:20.413270 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO neutron.service [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Neutron service started, listening on 0.0.0.0:9696
May 25 16:29:20.413346 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Notify callbacks [] for process, before_spawn {{(pid=91907) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:20.413550 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [-] (92012) wsgi starting up on http://0.0.0.0:9696
May 25 16:29:20.415495 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:20.415947 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO oslo_service.service [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Starting 1 workers
May 25 16:29:20.416828 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [-] (92013) wsgi starting up on http://0.0.0.0:9696
May 25 16:29:20.420933 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Started child 92014 {{(pid=91907) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 25 16:29:20.421466 dv-cinder-786386-6-iscsi neutron-server[91907]: INFO oslo_service.service [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Starting 1 workers
May 25 16:29:20.424411 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.service [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] calling RpcWorker wait() {{(pid=92014) _wait /opt/stack/neutron/neutron/service.py:128}}
May 25 16:29:20.424942 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.service [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] returning from RpcWorker wait() {{(pid=92014) _wait /opt/stack/neutron/neutron/service.py:135}}
May 25 16:29:20.425868 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Started child 92015 {{(pid=91907) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 25 16:29:20.426692 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:20.426895 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG neutron_lib.callbacks.manager [None req-3a0f8fe1-c34d-4d68-99f4-cd97c37fac09 None None] Notify callbacks [] for process, after_spawn {{(pid=91907) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:20.427295 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:29:20.428794 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91907) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 25 16:29:20.429004 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 25 16:29:20.429193 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 25 16:29:20.429432 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 25 16:29:20.429774 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 25 16:29:20.429936 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 25 16:29:20.430428 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.430723 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.430970 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:20.431441 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.431441 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.431566 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.432091 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.432183 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:29:20.432359 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.432624 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.432901 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.433165 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.433341 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.433533 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.433780 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.434030 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.434353 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.434635 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.434893 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.435177 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.435348 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.435613 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.435880 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.436127 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.436405 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] debug                          = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.436676 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.437156 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.437418 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.437683 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.437917 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.438186 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.438418 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.438697 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.438943 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.439179 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.439404 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.439665 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.440453 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.440671 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.440890 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.441162 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.441384 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.441887 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] host                           = dv-cinder-786386-6-iscsi {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.442136 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.442355 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.442603 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.442847 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.443090 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.443305 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.443556 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.443797 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.444040 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.444267 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.444520 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.444746 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.444996 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.445236 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.445477 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.445712 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.445939 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.446213 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.446406 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.446576 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.446763 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.447037 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.447203 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.447456 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.447692 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.447907 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.448122 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.448367 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.448598 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.448860 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.449100 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.449334 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.449576 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.449833 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.450058 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.450284 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.450587 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.450753 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.450991 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.451210 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.451424 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.451649 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.451864 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.452075 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.452336 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.452549 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.452814 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.453047 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.453296 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.453547 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.453777 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.454015 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.454274 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.454505 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.454753 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.455009 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.455223 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.455520 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.456234 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.456661 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.456661 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.456926 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.457728 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.457869 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.458008 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.458200 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.458419 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.459357 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.459357 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.459530 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.459739 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.460110 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.460527 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.460771 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.461016 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.461295 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.461565 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.461860 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.462099 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.462480 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.462728 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.463024 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.463253 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.463499 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.463792 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.464063 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.464360 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.464580 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.464820 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.465077 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.466308 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.466308 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.466308 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.466308 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.73/identity {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.466627 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.466696 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.466932 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.467155 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.467380 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.467609 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.467830 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.468121 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.468373 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.468590 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.468815 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.469066 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.469301 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.469560 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.469812 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.470699 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.470993 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.471195 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.471503 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.471675 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.471827 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.472045 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.472276 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.472556 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.472756 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.473002 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.473232 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.473474 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.473971 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.474244 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.474512 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.474736 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.474955 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.475199 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.475398 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.475631 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.475886 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.476129 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.476346 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.476565 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.476794 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.477047 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.477304 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.477567 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.477809 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.478031 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.478280 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.478493 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.478713 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.478930 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.479148 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.479365 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.479598 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.479823 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.480059 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.480271 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.480484 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.480700 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.480914 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.481205 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.481529 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.481778 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.482030 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.482291 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.482539 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.482780 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.483027 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.483249 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.483536 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.483782 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.484049 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.484282 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.484577 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.484839 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.485061 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.485329 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.485823 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.486254 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.486552 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.487373 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.487789 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.488269 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.488707 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.489033 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.489375 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.489705 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.490045 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.490369 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.490694 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.491146 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.491486 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.491795 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.492082 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.492345 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.492610 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.492871 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.493131 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.493368 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.493648 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.493879 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.494114 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.494335 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.494628 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.494862 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.495084 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.495499 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.496002 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.496521 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.496943 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.497187 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.497425 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.497731 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.498006 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.498229 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.498502 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.498746 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.499156 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.499549 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.499952 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.73/identity {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.500169 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.500593 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.500829 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.501043 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.501483 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.501879 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.502838 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.503255 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.503681 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.503953 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.504176 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.504403 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.504622 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.504902 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.505065 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.505315 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.505557 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.505799 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.506038 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.506260 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.506500 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.506725 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.506957 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.507223 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.507449 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.507725 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.508060 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.508383 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.508675 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.509159 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.509447 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.509667 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.510092 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.510458 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.510684 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.510904 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.511129 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.511349 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.511588 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.511835 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.512051 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.512306 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.512548 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.512893 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.513153 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.513427 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.513671 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.513909 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.514146 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.514399 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.514619 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.514836 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.515053 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.515269 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.515528 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.515770 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.515994 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.516211 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.516424 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.516634 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.516852 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.517082 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.517384 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.517653 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.517910 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.518150 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.518398 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.518631 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.518839 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.519050 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.519267 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.519477 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.519727 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.519958 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.520168 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.520384 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.520640 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.520817 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.521347 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.521347 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.521621 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.521749 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.521941 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.522149 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.522360 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.522575 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.522784 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.523124 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.523377 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.523619 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.523903 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.524133 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.524361 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.524635 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.525076 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.525212 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.525447 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.525690 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.525929 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.526169 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.526439 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.526756 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.527073 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.527348 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.527629 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.527919 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.528214 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:400:449'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.528477 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.528692 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.528982 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.529321 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.529621 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.529880 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.530111 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.530390 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.530631 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.530852 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.531070 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.531305 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.531523 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.531766 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.532022 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.532248 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.532491 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.532736 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.532975 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.533217 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.533492 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.533725 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.533981 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.534395 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 25 16:29:20.534727 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91907) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 25 16:29:20.534889 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 25 16:29:20.535043 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 25 16:29:20.535229 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 25 16:29:20.535377 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 25 16:29:20.535688 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 25 16:29:20.535896 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.536083 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.536220 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.536385 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.536547 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.536797 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.536971 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.537127 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.537457 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.538085 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.538404 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.538573 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.538731 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.539030 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.539335 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.539500 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.539661 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.539823 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.539987 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.540149 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.540304 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.540605 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.540763 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] debug                          = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.541085 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.541284 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.541506 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.541640 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.541801 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.541961 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.542123 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.542286 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.542448 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.542606 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.542766 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.542928 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.543085 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.543415 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.543578 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.543740 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.543902 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.544063 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] host                           = dv-cinder-786386-6-iscsi {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.544224 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.544383 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.544545 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.544704 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.544861 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.545171 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.545334 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.545528 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.545691 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.545850 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.546008 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.546170 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.546329 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.546488 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.546645 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.546804 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.546959 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.547120 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.547303 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.547468 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.547629 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.547790 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.547950 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.548108 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.548267 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.548426 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.548596 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.548741 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.548897 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.549738 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.549902 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.550083 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.550211 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.550365 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.550525 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.550684 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.550842 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.551267 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.551426 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.551586 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.551745 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.551904 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.552062 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.552220 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.552378 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.552539 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.552699 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.552858 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.553016 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.553175 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.553334 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.553516 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.553679 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.553840 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.553999 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.554158 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.554316 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.554476 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.554634 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.554792 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.554951 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.555111 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.555269 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.555428 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.555587 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.555784 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.555912 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.556048 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.556208 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 16:29:20.556403 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.556555 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.556731 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.556894 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.557057 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.557167 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:29:20.557290 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.557425 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.557551 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.557707 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.557868 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.558038 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.558201 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.558418 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.558547 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.558681 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.558845 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.559009 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.559169 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.559331 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.559491 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.559654 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.559815 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.559993 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.560663 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.560663 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.73/identity {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.560663 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.560663 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.560935 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.560935 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.561075 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.561208 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.561370 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.561624 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.561787 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.561950 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.562112 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.562274 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.562436 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.562599 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.562762 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.562927 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.563088 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.563250 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.563412 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.563575 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.563738 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.563901 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.564064 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.564226 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.564387 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.564559 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.564742 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.565529 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.565726 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.565856 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.566019 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.566181 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.566342 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.566503 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.566665 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.566826 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.567000 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.567161 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.567322 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.567484 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.567645 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.567812 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.567973 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.568135 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.568297 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.568459 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.568620 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.568781 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.568942 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.569105 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.569267 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.569447 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.569611 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.569774 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.570011 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.570263 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.570507 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.570666 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.570829 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.571176 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.571319 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.571701 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.571701 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.571941 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.572072 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.572156 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.572280 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.572427 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.572593 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.572755 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.572917 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.573079 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.573243 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.573447 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.573578 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.573925 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.573925 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.574160 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.574295 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.574417 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.574536 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.574654 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.574773 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.574935 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.575096 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.575614 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.575614 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.575614 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.576006 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.576006 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.576006 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.577195 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.577195 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.577195 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.577195 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.577195 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.577195 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.577195 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.577946 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.577946 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.577946 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.577946 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.577946 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.578484 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.578484 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.578484 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.578484 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.578871 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.578871 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.579049 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.579158 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.579266 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.579389 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.579550 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.579713 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.579875 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.580036 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.580200 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.580382 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.73/identity {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.580548 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.580710 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.580872 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.581033 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.581220 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.581351 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.581535 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.581698 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.581926 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.582025 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.582728 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.582728 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.582728 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.582728 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.583151 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.583151 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.583151 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.583355 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.583355 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.583518 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.583680 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.583841 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.584001 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.584160 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.584322 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.584485 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.584647 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.584809 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.585154 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.585154 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.585370 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.585495 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.585604 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.585767 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.585931 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.586087 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.586243 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.586405 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.586568 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.586728 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.586892 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.587053 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.587215 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.587391 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.587552 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.587714 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.587881 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.588040 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.588203 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.588363 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.588525 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.588685 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.588847 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.589007 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.589170 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.589336 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.589520 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.589682 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.589844 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.590005 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.590167 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.590327 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.590500 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.590662 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.590824 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.590986 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.591147 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.591317 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.591478 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.591640 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.591800 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.591961 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.592132 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.592292 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.592453 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.592613 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.592773 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.592944 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.593106 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.593268 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.593448 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.593612 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.593782 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.593942 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.594103 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.594263 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.594424 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.594596 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.594759 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.594919 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.595088 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.595249 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.595410 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.595572 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.595745 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.595908 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.596094 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.596258 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.596419 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.596581 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.596748 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.596915 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.597081 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.597246 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.597447 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.597613 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.597789 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:400:449'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.597959 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.598120 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.598289 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.598462 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.598625 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.598785 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.598947 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.599110 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.599271 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.599522 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.599731 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.599899 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.600111 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.600277 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.600722 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.600722 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.600957 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.601078 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.601198 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.601318 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.601457 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.601616 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.601778 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 16:29:20.601933 dv-cinder-786386-6-iscsi neutron-server[91907]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 25 16:29:20.640048 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 48744) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:29:20.650008 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [-] 10.222.0.73 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0077541
May 25 16:29:31.451419 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54d0aec6-919f-42f8-9a2a-2cdd0dc66bbb None None] get_active_networks_info from dv-cinder-786386-6-iscsi {{(pid=92014) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
May 25 16:29:31.522029 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54d0aec6-919f-42f8-9a2a-2cdd0dc66bbb None None] No non-hosted networks {{(pid=92014) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
May 25 16:29:31.533803 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.agentschedulers_db [None req-54d0aec6-919f-42f8-9a2a-2cdd0dc66bbb None None] DHCP Agent not found on host dv-cinder-786386-6-iscsi {{(pid=92014) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}}
May 25 16:29:31.626430 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-a0ed8d74-74fc-4ff7-9b08-8328a4769457 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190'] for agent, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:33.832563 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190'] for agent, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:33.834073 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:33.834709 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:33.835274 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:33.835803 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:33.836362 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:33.836948 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:33.837790 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:33.838375 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:33.838933 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:33.839506 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:33.840044 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:33.840582 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:33.841241 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7f346bb68ca0>, 'Open vSwitch agent', 'dv-cinder-786386-6-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:29:33.851047 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7f346bbdd580>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-786386-6-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:29:34.083233 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2f2ab74a-7ca1-4425-a2d5-36f184f7898e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190'] for agent, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:34.155785 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-a30e83a0-4d3a-449c-bccf-e8312c26942f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:35.024465 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190'] for agent, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:36.528410 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190'] for agent, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:37.177786 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.db.l3_hamode_db [None req-8c3b03b4-7eea-4a8e-8d61-55a39a24737a None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
May 25 16:29:37.261303 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c3b03b4-7eea-4a8e-8d61-55a39a24737a None None] Routers set() bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:29:37.261735 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c3b03b4-7eea-4a8e-8d61-55a39a24737a None None] Router IDs set() for agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
May 25 16:29:38.188429 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 48836) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:29:38.776265 dv-cinder-786386-6-iscsi neutron-server[92013]: WARNING oslo_policy.policy [None req-e8f5943d-06e8-44e8-88cf-bef45cc28bfc admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 16:29:38.776833 dv-cinder-786386-6-iscsi neutron-server[92013]: WARNING oslo_policy.policy [None req-e8f5943d-06e8-44e8-88cf-bef45cc28bfc admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 16:29:38.990731 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [None req-e8f5943d-06e8-44e8-88cf-bef45cc28bfc admin admin] http://10.222.0.73:9696/v2.0/extensions returned with HTTP 200 {{(pid=92013) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 16:29:38.991759 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-e8f5943d-06e8-44e8-88cf-bef45cc28bfc admin admin] 10.222.0.73 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8024232
May 25 16:29:41.312315 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 48850) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:29:41.695537 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-5c016644-090d-4758-89cb-50e421d8a001 admin admin] Request body: {'subnetpool': {'is_default': True, 'shared': True, 'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:29:41.797848 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.policy [None req-5c016644-090d-4758-89cb-50e421d8a001 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=92013) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 25 16:29:41.843584 dv-cinder-786386-6-iscsi neutron-server[92013]: WARNING oslo_policy.policy [None req-5c016644-090d-4758-89cb-50e421d8a001 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 16:29:41.843947 dv-cinder-786386-6-iscsi neutron-server[92013]: WARNING oslo_policy.policy [None req-5c016644-090d-4758-89cb-50e421d8a001 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 16:29:41.852794 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.quota [None req-5c016644-090d-4758-89cb-50e421d8a001 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7f346c21fb20>.
May 25 16:29:41.868516 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-5c016644-090d-4758-89cb-50e421d8a001 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:29:41.926861 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5c016644-090d-4758-89cb-50e421d8a001 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8741448321999', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8741448332646', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8741448375954', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8741448370766', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8741448359105', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8741448365863', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1524372', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1561878', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-401152', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-473325'] for rbac-policy, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:41.988133 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5c016644-090d-4758-89cb-50e421d8a001 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:41.989227 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-5c016644-090d-4758-89cb-50e421d8a001 admin admin] 10.222.0.73 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 0.6759396
May 25 16:29:44.590276 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 48864) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:29:45.184368 dv-cinder-786386-6-iscsi neutron-server[92012]: WARNING oslo_policy.policy [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 16:29:45.185724 dv-cinder-786386-6-iscsi neutron-server[92012]: WARNING oslo_policy.policy [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 16:29:45.399344 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Request body: {'network': {'name': 'private', 'admin_state_up': True, 'project_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:29:45.401028 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.quota [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7f346c53ba30>.
May 25 16:29:45.417823 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:29:45.425134 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Usage tracker for resource:network and tenant:bc01a6db705b4bef9240c34ace7c4d7b is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:29:45.431136 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:29:45.438915 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:29:45.456298 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Made reservation on behalf of bc01a6db705b4bef9240c34ace7c4d7b for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:29:45.528039 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.policy [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=92012) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 25 16:29:45.574136 dv-cinder-786386-6-iscsi neutron-server[92012]: WARNING oslo_policy.policy [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 16:29:45.574519 dv-cinder-786386-6-iscsi neutron-server[92012]: WARNING oslo_policy.policy [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 16:29:45.584961 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:45.606972 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:45.622696 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:29:45.627171 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Usage tracker for resource:security_group_rule and tenant:bc01a6db705b4bef9240c34ace7c4d7b is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:29:45.632498 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:29:45.639637 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:29:45.742719 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:45.746592 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:45.752267 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:29:45.769794 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 400}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:29:45.795461 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8741446462181', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:45.796062 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7f346cfaae50> segment precommit_create {{(pid=92012) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 25 16:29:45.796548 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Added segment 828e6dc1-8163-4890-ac2b-db9f59737de3 of type vlan for network 8686733d-7a46-4e4f-9691-3e62118c507c
May 25 16:29:45.848531 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6024e4cf-4929-4ce9-a8cd-d32fcaeedaeb,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:29:45.866045 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:45.866384 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:45.866704 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:45.867018 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:45.867323 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:45.867640 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:45.867945 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:45.868245 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:45.868561 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:45.868862 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:45.869161 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:45.869482 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Tracked resource versions report:
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]: pushed versions:
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]: {   'AddressGroup': {'1.2'},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     'ConntrackHelper': {'1.0'},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     'Log': {'1.0'},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     'Network': {'1.1'},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     'Port': {'1.7'},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     'PortForwarding': {'1.2'},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     'QosPolicy': {'1.8'},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     'SecurityGroup': {'1.4'},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     'SecurityGroupRule': {'1.2'},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     'SubPort': {'1.0'},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     'Subnet': {'1.1'},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     'Trunk': {'1.1'}}
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]: consumer versions:
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]: {   DHCP agent@dv-cinder-786386-6-iscsi: {},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     L3 agent@dv-cinder-786386-6-iscsi: {},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     Metadata agent@dv-cinder-786386-6-iscsi: {},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     Metering agent@dv-cinder-786386-6-iscsi: {},
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:     Open vSwitch agent@dv-cinder-786386-6-iscsi: {   'AddressGroup': '1.2',
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'ConntrackHelper': '1.0',
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'Log': '1.0',
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'Network': '1.1',
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'Port': '1.7',
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'PortForwarding': '1.2',
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'QosPolicy': '1.8',
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'SecurityGroup': '1.4',
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'SecurityGroupRule': '1.2',
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'SubPort': '1.0',
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'Subnet': '1.1',
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'Trunk': '1.1'}}
May 25 16:29:45.870579 dv-cinder-786386-6-iscsi neutron-server[92012]:  {{(pid=92012) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 16:29:45.919189 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:45.923024 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:29:45.961056 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:45.962604 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:29:45.963252 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:45.967638 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:29:46.068936 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 849 time: 1.4764082
May 25 16:29:46.073815 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Pushing event updated for resources: {'Network': ['ID=8686733d-7a46-4e4f-9691-3e62118c507c,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:29:46.095033 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:29:46.103973 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network 8686733d-7a46-4e4f-9691-3e62118c507c details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:29:48.746941 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 48886) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:29:49.192401 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5e480fa-f5a5-4264-906d-33452981087d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:29:49.193739 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f5e480fa-f5a5-4264-906d-33452981087d admin admin] 10.222.0.73 "GET /v2.0/networks/8686733d-7a46-4e4f-9691-3e62118c507c HTTP/1.1" status: 200  len: 825 time: 0.4458113
May 25 16:29:49.223557 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-70c4ac82-825f-4e28-9fcc-4d086a1331c0 admin admin] 10.222.0.73 "GET /v2.0/subnetpools/8eedbd88-7e47-4e40-b894-e3b7da7b7e01 HTTP/1.1" status: 200  len: 734 time: 0.0245128
May 25 16:29:49.231917 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Request body: {'subnet': {'gateway_ip': '172.20.0.1', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c', 'ip_version': 4, 'name': 'private-subnet', 'subnetpool_id': '8eedbd88-7e47-4e40-b894-e3b7da7b7e01'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:29:49.236724 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:29:49.240433 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Usage tracker for resource:subnet and tenant:bc01a6db705b4bef9240c34ace7c4d7b is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:29:49.243269 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:29:49.249146 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:29:49.259116 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Made reservation on behalf of bc01a6db705b4bef9240c34ace7c4d7b for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:29:49.261639 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Notify callbacks [] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:49.722337 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:49.727189 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:29:49.806425 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Pushing event updated for resources: {'Subnet': ['ID=b2ccc23b-f7d7-4620-b322-657a01777ce0,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:29:49.810103 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:29:49.811100 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Checking segment: {'id': '828e6dc1-8163-4890-ac2b-db9f59737de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:29:49.811413 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Network hostable DHCP agents. Network: 8686733d-7a46-4e4f-9691-3e62118c507c, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:29:49.830245 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Network 8686733d-7a46-4e4f-9691-3e62118c507c is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:29:49.840342 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, 8686733d-7a46-4e4f-9691-3e62118c507c) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:29:49.845065 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:29:49.846212 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:49.850435 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c95ff0d-b417-441b-8f2c-b1c7eff2dccd None None] Network 8686733d-7a46-4e4f-9691-3e62118c507c requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:29:49.865750 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 0.6370964
May 25 16:29:50.157368 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d60576c-5158-50e8-99d6-6272b1af5e3f-8686733d-7a46-4e4f-9691-3e62118c507c', 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'fixed_ips': [{'subnet_id': 'b2ccc23b-f7d7-4620-b322-657a01777ce0'}]}} from dv-cinder-786386-6-iscsi. {{(pid=92014) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 16:29:50.158572 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:50.343716 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.db_base_plugin_common [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Allocated IP 172.20.0.2 (8686733d-7a46-4e4f-9691-3e62118c507c/b2ccc23b-f7d7-4620-b322-657a01777ce0/b4e1496d-df11-4337-a227-6cf7ed33f211) {{(pid=92014) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:29:50.584841 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Notify callbacks [] for port, precommit_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:50.598102 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Transition to ACTIVE for port object b4e1496d-df11-4337-a227-6cf7ed33f211 will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:29:50.618140 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Transition to ACTIVE for port object b4e1496d-df11-4337-a227-6cf7ed33f211 will not be triggered until provisioned by entity DHCP. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:29:50.625853 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:50.631767 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:29:50.691526 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Network 8686733d-7a46-4e4f-9691-3e62118c507c is already hosted by enough agents. {{(pid=92014) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:29:50.694373 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.base_scheduler [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Resources bound (agent type, host, resource id):  {{(pid=92014) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:29:50.700018 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Received port after_create {{(pid=92014) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:29:50.706136 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Pushing event updated for resources: {'Port': ['ID=b4e1496d-df11-4337-a227-6cf7ed33f211,revision_number=1']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:29:50.713908 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:50.714239 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:50.714565 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:50.714879 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:50.715193 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:50.715506 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:50.715810 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:50.716114 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:50.716433 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:50.716739 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:50.717039 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:50.717339 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Tracked resource versions report:
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]: pushed versions:
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]: {   'AddressGroup': {'1.2'},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     'ConntrackHelper': {'1.0'},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     'Log': {'1.0'},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     'Network': {'1.1'},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     'Port': {'1.7'},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     'PortForwarding': {'1.2'},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     'QosPolicy': {'1.8'},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     'SecurityGroup': {'1.4'},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     'SecurityGroupRule': {'1.2'},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     'SubPort': {'1.0'},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     'Subnet': {'1.1'},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     'Trunk': {'1.1'}}
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]: consumer versions:
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]: {   DHCP agent@dv-cinder-786386-6-iscsi: {},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     L3 agent@dv-cinder-786386-6-iscsi: {},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     Metadata agent@dv-cinder-786386-6-iscsi: {},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     Metering agent@dv-cinder-786386-6-iscsi: {},
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:     Open vSwitch agent@dv-cinder-786386-6-iscsi: {   'AddressGroup': '1.2',
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'ConntrackHelper': '1.0',
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'Log': '1.0',
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'Network': '1.1',
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'Port': '1.7',
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'PortForwarding': '1.2',
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'QosPolicy': '1.8',
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'SecurityGroup': '1.4',
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'SecurityGroupRule': '1.2',
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'SubPort': '1.0',
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'Subnet': '1.1',
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'Trunk': '1.1'}}
May 25 16:29:50.718458 dv-cinder-786386-6-iscsi neutron-server[92014]:  {{(pid=92014) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 16:29:50.753843 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:29:50.807089 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Attempting to bind port b4e1496d-df11-4337-a227-6cf7ed33f211 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:29:50.807474 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Attempting to bind port b4e1496d-df11-4337-a227-6cf7ed33f211 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '828e6dc1-8163-4890-ac2b-db9f59737de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:29:50.807889 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Attempting to bind port b4e1496d-df11-4337-a227-6cf7ed33f211 on network 8686733d-7a46-4e4f-9691-3e62118c507c {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:29:50.813068 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 29, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:29:50.813490 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Checking segment: {'id': '828e6dc1-8163-4890-ac2b-db9f59737de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:29:50.813942 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:50.814937 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Bound using segment: {'id': '828e6dc1-8163-4890-ac2b-db9f59737de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:29:50.815397 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Bound port: b4e1496d-df11-4337-a227-6cf7ed33f211, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '828e6dc1-8163-4890-ac2b-db9f59737de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:29:50.815778 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:50.902782 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] For port b4e1496d-df11-4337-a227-6cf7ed33f211, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:29:50.906576 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] For port b4e1496d-df11-4337-a227-6cf7ed33f211, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=b4e1496d-df11-4337-a227-6cf7ed33f211,segment=NetworkSegment(828e6dc1-8163-4890-ac2b-db9f59737de3),segment_id=828e6dc1-8163-4890-ac2b-db9f59737de3)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:29:50.911632 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:50.915371 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:29:51.001164 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Pushing event updated for resources: {'Port': ['ID=b4e1496d-df11-4337-a227-6cf7ed33f211,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:29:51.005750 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:29:52.275242 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 48896) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:29:52.657084 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [None req-75fdc8f6-3b75-4a37-bd30-4d23c5d874b1 admin admin] http://10.222.0.73:9696/v2.0/extensions returned with HTTP 200 {{(pid=92012) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 16:29:52.663083 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-75fdc8f6-3b75-4a37-bd30-4d23c5d874b1 admin admin] 10.222.0.73 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3823402
May 25 16:29:55.044523 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 48906) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:29:55.440066 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [None req-39a658a0-6a9e-41d8-8be5-90041ccfb0ef admin admin] http://10.222.0.73:9696/v2.0/extensions returned with HTTP 200 {{(pid=92013) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 16:29:55.441028 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-39a658a0-6a9e-41d8-8be5-90041ccfb0ef admin admin] 10.222.0.73 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3933530
May 25 16:29:55.817702 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device b4e1496d-df11-4337-a227-6cf7ed33f211 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:29:55.889205 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port b4e1496d-df11-4337-a227-6cf7ed33f211 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:29:56.618170 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e364df44-2819-48b0-b8c3-04fa54f4c04d None None] Network 8686733d-7a46-4e4f-9691-3e62118c507c requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:29:56.707983 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-99a92536-a5ca-4b77-86d7-fea6c24bc1a9 None None] Provisioning for port b4e1496d-df11-4337-a227-6cf7ed33f211 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:29:56.715866 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-99a92536-a5ca-4b77-86d7-fea6c24bc1a9 None None] Provisioning complete for port b4e1496d-df11-4337-a227-6cf7ed33f211 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:29:56.716267 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-99a92536-a5ca-4b77-86d7-fea6c24bc1a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:56.963500 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-99a92536-a5ca-4b77-86d7-fea6c24bc1a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:57.040504 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-99a92536-a5ca-4b77-86d7-fea6c24bc1a9 None None] For port b4e1496d-df11-4337-a227-6cf7ed33f211, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=b4e1496d-df11-4337-a227-6cf7ed33f211,segment=NetworkSegment(828e6dc1-8163-4890-ac2b-db9f59737de3),segment_id=828e6dc1-8163-4890-ac2b-db9f59737de3)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:29:57.045310 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-99a92536-a5ca-4b77-86d7-fea6c24bc1a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:57.050389 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:29:57.126859 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99a92536-a5ca-4b77-86d7-fea6c24bc1a9 None None] Pushing event updated for resources: {'Port': ['ID=b4e1496d-df11-4337-a227-6cf7ed33f211,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:29:57.130276 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-99a92536-a5ca-4b77-86d7-fea6c24bc1a9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:29:57.370925 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-a04d7c9b-5cdd-41d8-9282-eae065152cb9 None None] Provisioning complete for port b4e1496d-df11-4337-a227-6cf7ed33f211 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:29:57.371293 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-a04d7c9b-5cdd-41d8-9282-eae065152cb9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:57.794627 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device b4e1496d-df11-4337-a227-6cf7ed33f211 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:29:57.860644 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port b4e1496d-df11-4337-a227-6cf7ed33f211 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:29:57.861616 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:58.077028 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 48922) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:29:58.423717 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-a593ad7a-1eb3-4939-9029-f6b256d8db0d admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'name': 'router1'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:29:58.428423 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-a593ad7a-1eb3-4939-9029-f6b256d8db0d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:29:58.432867 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-a593ad7a-1eb3-4939-9029-f6b256d8db0d admin admin] Usage tracker for resource:router and tenant:bc01a6db705b4bef9240c34ace7c4d7b is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:29:58.436415 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-a593ad7a-1eb3-4939-9029-f6b256d8db0d admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:29:58.445340 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-a593ad7a-1eb3-4939-9029-f6b256d8db0d admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:29:58.455095 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-a593ad7a-1eb3-4939-9029-f6b256d8db0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-506971', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2375'] for router, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:58.456759 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-a593ad7a-1eb3-4939-9029-f6b256d8db0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-504667', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-501124', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1593705', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2380'] for router, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:58.479979 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-a593ad7a-1eb3-4939-9029-f6b256d8db0d admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:58.596218 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-a593ad7a-1eb3-4939-9029-f6b256d8db0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-506962', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-501218'] for router, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:58.614355 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-a593ad7a-1eb3-4939-9029-f6b256d8db0d admin admin] Notify callbacks [] for router, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:29:58.615514 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-a593ad7a-1eb3-4939-9029-f6b256d8db0d admin admin] 10.222.0.73 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.5375233
May 25 16:30:00.947676 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 48932) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:30:01.310408 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [None req-5a8b2f83-fb97-4978-ab56-21dad74b5999 admin admin] http://10.222.0.73:9696/v2.0/extensions returned with HTTP 200 {{(pid=92012) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 16:30:01.311375 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-5a8b2f83-fb97-4978-ab56-21dad74b5999 admin admin] 10.222.0.73 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3628132
May 25 16:30:01.351755 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-a863fcfe-511d-4736-87e2-ee1bfe9d6f77 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:03.681793 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 48942) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:30:03.787260 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:04.055088 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Request body: {'network': {'admin_state_up': True, 'provider:network_type': 'flat', 'provider:physical_network': 'physnet1', 'is_default': True, 'router:external': True, 'name': 'public'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:30:04.060281 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:30:04.064071 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Usage tracker for resource:network and tenant:281b87fe66334a1497a5f10f0bcc68bc is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:30:04.068271 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:30:04.072303 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-96e58fd8-aa0b-477a-9f83-be42a8f2e78f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:04.074016 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:30:04.083089 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Made reservation on behalf of 281b87fe66334a1497a5f10f0bcc68bc for: {'network': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:30:04.085738 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:04.101512 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:04.115997 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:30:04.119592 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Usage tracker for resource:security_group_rule and tenant:281b87fe66334a1497a5f10f0bcc68bc is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:30:04.122664 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:30:04.128719 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:30:04.222815 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:04.226352 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:04.231245 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:30:04.242292 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Reserving flat network on physical network physnet1 {{(pid=92013) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
May 25 16:30:04.271291 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8741446462181', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:04.271869 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7f346cfaae50> segment precommit_create {{(pid=92013) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 25 16:30:04.272348 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.segments_db [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Added segment 7eb8861e-7e01-42c3-9125-cf4be9b46f45 of type flat for network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb
May 25 16:30:04.325690 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f8f9517f-2f7f-4664-b693-2daed5461820,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:30:04.347133 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:04.347505 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:04.347849 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:04.348231 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:04.348508 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:04.348854 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:04.349231 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:04.349630 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:04.349979 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:04.350284 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:04.350582 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:04.350879 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Tracked resource versions report:
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]: pushed versions:
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]: {   'AddressGroup': {'1.2'},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     'ConntrackHelper': {'1.0'},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     'Log': {'1.0'},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     'Network': {'1.1'},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     'Port': {'1.7'},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     'PortForwarding': {'1.2'},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     'QosPolicy': {'1.8'},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     'SecurityGroup': {'1.4'},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     'SecurityGroupRule': {'1.2'},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     'SubPort': {'1.0'},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     'Subnet': {'1.1'},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     'Trunk': {'1.1'}}
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]: consumer versions:
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]: {   DHCP agent@dv-cinder-786386-6-iscsi: {},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     L3 agent@dv-cinder-786386-6-iscsi: {},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     Metadata agent@dv-cinder-786386-6-iscsi: {},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     Metering agent@dv-cinder-786386-6-iscsi: {},
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:     Open vSwitch agent@dv-cinder-786386-6-iscsi: {   'AddressGroup': '1.2',
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'ConntrackHelper': '1.0',
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'Log': '1.0',
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'Network': '1.1',
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'Port': '1.7',
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'PortForwarding': '1.2',
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'QosPolicy': '1.8',
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'SecurityGroup': '1.4',
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'SecurityGroupRule': '1.2',
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'SubPort': '1.0',
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'Subnet': '1.1',
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'Trunk': '1.1'}}
May 25 16:30:04.351943 dv-cinder-786386-6-iscsi neutron-server[92013]:  {{(pid=92013) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 16:30:04.397127 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:30:04.400660 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:04.443036 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:04.444554 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:30:04.445201 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:04.449933 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:30:04.558478 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.8743393
May 25 16:30:04.558478 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Pushing event updated for resources: {'Network': ['ID=fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:30:04.561195 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:30:04.569792 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:30:04.976286 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:06.471281 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:06.880627 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 48966) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:30:07.091482 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-566a6074-d18e-47e7-bb25-9ada4bfadd89 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:30:07.092778 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-566a6074-d18e-47e7-bb25-9ada4bfadd89 admin admin] 10.222.0.73 "GET /v2.0/subnets/b2ccc23b-f7d7-4620-b322-657a01777ce0 HTTP/1.1" status: 200  len: 849 time: 0.2112465
May 25 16:30:07.284688 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-0f833381-8aa4-42d4-9a5d-f14cbad7c643 admin admin] 10.222.0.73 "GET /v2.0/routers/10384943-9e1c-4163-99eb-e01a0b823ede HTTP/1.1" status: 200  len: 704 time: 0.1863070
May 25 16:30:07.747047 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:07.988666 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Allocated IP 172.20.0.1 (8686733d-7a46-4e4f-9691-3e62118c507c/b2ccc23b-f7d7-4620-b322-657a01777ce0/89f1e80a-f976-48f6-85b7-25e0f36ab49c) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:30:08.141676 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:08.158987 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Transition to ACTIVE for port object 89f1e80a-f976-48f6-85b7-25e0f36ab49c will not be triggered until provisioned by entity DHCP. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:30:08.213368 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:08.217746 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:30:08.281655 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Network 8686733d-7a46-4e4f-9691-3e62118c507c is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:30:08.284951 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:30:08.288418 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:30:08.288940 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-501395'] for router_interface, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:08.408932 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Pushing event updated for resources: {'Port': ['ID=89f1e80a-f976-48f6-85b7-25e0f36ab49c,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:30:08.424215 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:30:08.471697 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-e55522ae-ec8f-4b56-aeba-84438c625c29 None None] Provisioning for port 89f1e80a-f976-48f6-85b7-25e0f36ab49c completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:30:08.476870 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-e55522ae-ec8f-4b56-aeba-84438c625c29 None None] Provisioning complete for port 89f1e80a-f976-48f6-85b7-25e0f36ab49c triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:30:08.477253 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-e55522ae-ec8f-4b56-aeba-84438c625c29 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:08.529289 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-e55522ae-ec8f-4b56-aeba-84438c625c29 None None] Port 89f1e80a-f976-48f6-85b7-25e0f36ab49c cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:30:08.588077 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:08.838052 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:08.843277 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:08.844517 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630485', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-501310'] for router_interface, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:08.848592 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:30:08.929074 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Pushing event updated for resources: {'Port': ['ID=89f1e80a-f976-48f6-85b7-25e0f36ab49c,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:30:08.934040 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:30:09.047198 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Network 8686733d-7a46-4e4f-9691-3e62118c507c is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:30:09.048836 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:30:09.236599 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Router 10384943-9e1c-4163-99eb-e01a0b823ede is scheduled to L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 with binding_index 1 {{(pid=92012) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 16:30:09.253210 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-982d20c3-b43e-479f-8955-234ec9d55dc1 None None] Provisioning complete for port 89f1e80a-f976-48f6-85b7-25e0f36ab49c triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:30:09.253614 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-982d20c3-b43e-479f-8955-234ec9d55dc1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:09.309096 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-982d20c3-b43e-479f-8955-234ec9d55dc1 None None] Port 89f1e80a-f976-48f6-85b7-25e0f36ab49c cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:30:09.386560 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:30:09.396090 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] 10.222.0.73 "PUT /v2.0/routers/10384943-9e1c-4163-99eb-e01a0b823ede/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.1066382
May 25 16:30:09.396488 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Sync routers for ids ['10384943-9e1c-4163-99eb-e01a0b823ede'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:30:09.406470 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Routers {'10384943-9e1c-4163-99eb-e01a0b823ede'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:30:09.407304 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-4e700676-5264-42e4-992e-06076cd26419 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346c4c37f0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:30:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['10384943-9e1c-4163-99eb-e01a0b823ede'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:30:09.582733 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Set router 10384943-9e1c-4163-99eb-e01a0b823ede gateway port host: None {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:30:09.947872 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-4e700676-5264-42e4-992e-06076cd26419 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346c4c37f0>, [{'id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'name': 'router1', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:29:58Z', 'updated_at': '2021-05-25T16:30:08Z', 'revision_number': 2, 'project_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'gw_port_host': None, '_interfaces': [{'id': '89f1e80a-f976-48f6-85b7-25e0f36ab49c', 'name': '', 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'mac_address': 'fa:16:3e:5a:7d:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'b2ccc23b-f7d7-4620-b322-657a01777ce0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:30:07Z', 'updated_at': '2021-05-25T16:30:08Z', 'revision_number': 2, 'project_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'subnets': [{'id': 'b2ccc23b-f7d7-4620-b322-657a01777ce0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '8eedbd88-7e47-4e40-b894-e3b7da7b7e01'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:30:09.952711 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Checking router: 10384943-9e1c-4163-99eb-e01a0b823ede for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:30:09.953079 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Updating router 10384943-9e1c-4163-99eb-e01a0b823ede port 89f1e80a-f976-48f6-85b7-25e0f36ab49c binding host dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:30:10.007414 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:10.386258 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Notify callbacks [] for port, precommit_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:10.402312 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.provisioning_blocks [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Transition to ACTIVE for port object 89f1e80a-f976-48f6-85b7-25e0f36ab49c will not be triggered until provisioned by entity L2. {{(pid=92015) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:30:10.409252 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:10.415992 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:30:10.608729 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Pushing event updated for resources: {'Port': ['ID=89f1e80a-f976-48f6-85b7-25e0f36ab49c,revision_number=3']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:30:10.635197 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:10.635531 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:10.635905 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:10.636197 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:10.636817 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:10.637130 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:10.638512 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:10.638813 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:10.639613 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:10.639945 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:10.640420 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:10.640901 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Tracked resource versions report:
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]: pushed versions:
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]: {   'AddressGroup': {'1.2'},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     'ConntrackHelper': {'1.0'},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     'Log': {'1.0'},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     'Network': {'1.1'},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     'Port': {'1.7'},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     'PortForwarding': {'1.2'},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     'QosPolicy': {'1.8'},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     'SecurityGroup': {'1.4'},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     'SecurityGroupRule': {'1.2'},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     'SubPort': {'1.0'},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     'Subnet': {'1.1'},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     'Trunk': {'1.1'}}
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]: consumer versions:
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]: {   DHCP agent@dv-cinder-786386-6-iscsi: {},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     L3 agent@dv-cinder-786386-6-iscsi: {},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     Metadata agent@dv-cinder-786386-6-iscsi: {},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     Metering agent@dv-cinder-786386-6-iscsi: {},
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:     Open vSwitch agent@dv-cinder-786386-6-iscsi: {   'AddressGroup': '1.2',
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'ConntrackHelper': '1.0',
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'Log': '1.0',
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'Network': '1.1',
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'Port': '1.7',
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'PortForwarding': '1.2',
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'QosPolicy': '1.8',
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'SecurityGroup': '1.4',
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'SecurityGroupRule': '1.2',
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'SubPort': '1.0',
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'Subnet': '1.1',
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'Trunk': '1.1'}}
May 25 16:30:10.642463 dv-cinder-786386-6-iscsi neutron-server[92015]:  {{(pid=92015) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 16:30:10.653168 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:30:10.658093 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Attempting to bind port 89f1e80a-f976-48f6-85b7-25e0f36ab49c on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:30:10.658474 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Attempting to bind port 89f1e80a-f976-48f6-85b7-25e0f36ab49c by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '828e6dc1-8163-4890-ac2b-db9f59737de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c'}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:30:10.658901 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Attempting to bind port 89f1e80a-f976-48f6-85b7-25e0f36ab49c on network 8686733d-7a46-4e4f-9691-3e62118c507c {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:30:10.664155 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 30, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:30:10.664553 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Checking segment: {'id': '828e6dc1-8163-4890-ac2b-db9f59737de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92015) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:30:10.664994 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:10.665372 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Bound using segment: {'id': '828e6dc1-8163-4890-ac2b-db9f59737de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c'} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:30:10.665922 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Bound port: 89f1e80a-f976-48f6-85b7-25e0f36ab49c, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '828e6dc1-8163-4890-ac2b-db9f59737de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c'}}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:30:10.666298 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:10.752053 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-4e700676-5264-42e4-992e-06076cd26419 None None] For port 89f1e80a-f976-48f6-85b7-25e0f36ab49c, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92015) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:30:10.756454 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-4e700676-5264-42e4-992e-06076cd26419 None None] For port 89f1e80a-f976-48f6-85b7-25e0f36ab49c, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=89f1e80a-f976-48f6-85b7-25e0f36ab49c,segment=NetworkSegment(828e6dc1-8163-4890-ac2b-db9f59737de3),segment_id=828e6dc1-8163-4890-ac2b-db9f59737de3)] {{(pid=92015) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:30:10.760154 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:10.764740 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:30:10.849681 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Routers {'10384943-9e1c-4163-99eb-e01a0b823ede'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:30:10.850311 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-4e700676-5264-42e4-992e-06076cd26419 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346c4c37f0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:30:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['10384943-9e1c-4163-99eb-e01a0b823ede'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:30:10.904721 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Pushing event updated for resources: {'Port': ['ID=89f1e80a-f976-48f6-85b7-25e0f36ab49c,revision_number=4']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:30:10.919252 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:30:11.041971 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-4e700676-5264-42e4-992e-06076cd26419 None None] Set router 10384943-9e1c-4163-99eb-e01a0b823ede gateway port host: None {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:30:11.362791 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-4e700676-5264-42e4-992e-06076cd26419 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346c4c37f0>, [{'id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'name': 'router1', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:29:58Z', 'updated_at': '2021-05-25T16:30:08Z', 'revision_number': 2, 'project_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'gw_port_host': None, '_interfaces': [{'id': '89f1e80a-f976-48f6-85b7-25e0f36ab49c', 'name': '', 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'mac_address': 'fa:16:3e:5a:7d:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'b2ccc23b-f7d7-4620-b322-657a01777ce0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:30:07Z', 'updated_at': '2021-05-25T16:30:10Z', 'revision_number': 4, 'project_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'subnets': [{'id': 'b2ccc23b-f7d7-4620-b322-657a01777ce0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '8eedbd88-7e47-4e40-b894-e3b7da7b7e01'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:30:11.366698 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e700676-5264-42e4-992e-06076cd26419 None None] The sync data for ids ['10384943-9e1c-4163-99eb-e01a0b823ede'] in dv-cinder-786386-6-iscsi is: [{'id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'name': 'router1', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:29:58Z', 'updated_at': '2021-05-25T16:30:08Z', 'revision_number': 2, 'project_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'gw_port_host': None, '_interfaces': [{'id': '89f1e80a-f976-48f6-85b7-25e0f36ab49c', 'name': '', 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'mac_address': 'fa:16:3e:5a:7d:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'b2ccc23b-f7d7-4620-b322-657a01777ce0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:30:07Z', 'updated_at': '2021-05-25T16:30:10Z', 'revision_number': 4, 'project_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'subnets': [{'id': 'b2ccc23b-f7d7-4620-b322-657a01777ce0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '8eedbd88-7e47-4e40-b894-e3b7da7b7e01'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:30:11.599489 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 48988) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:30:11.749409 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5274eff-e594-4f69-949e-0688796d2624 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:30:11.753859 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f5274eff-e594-4f69-949e-0688796d2624 admin admin] 10.222.0.73 "GET /v2.0/networks/fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb HTTP/1.1" status: 200  len: 842 time: 0.1533775
May 25 16:30:11.759973 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Request body: {'subnet': {'ip_version': 4, 'enable_dhcp': False, 'name': 'public-subnet', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:30:11.765131 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:30:11.769915 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Usage tracker for resource:subnet and tenant:281b87fe66334a1497a5f10f0bcc68bc is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:30:11.772692 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:30:11.778336 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:30:11.788996 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Made reservation on behalf of 281b87fe66334a1497a5f10f0bcc68bc for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:30:11.791350 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:12.240197 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.objects.ports [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=92012) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
May 25 16:30:12.240624 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:12.244424 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-081f6702-474c-4ed3-b6d9-e83d9b64886a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:30:12.312719 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Pushing event updated for resources: {'Subnet': ['ID=772b799b-fb95-46a6-ab51-ab34127985e2,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:30:12.316430 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:30:12.322521 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Checking segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:30:12.322865 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Network hostable DHCP agents. Network: fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:30:12.339606 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:30:12.349215 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:30:12.353201 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:30:12.353758 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:12.359319 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad67e441-ef45-418e-82ae-a4e08a4e6c8f None None] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:30:12.377589 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 0.6210155
May 25 16:30:12.570415 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd8b7af5-4750-46ac-a78a-b36e25bcb9e9 None None] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:30:14.624785 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 49002) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:30:14.831689 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-74c1f243-d98a-4e15-8cad-8972121001c7 admin admin] 10.222.0.73 "GET /v2.0/routers/10384943-9e1c-4163-99eb-e01a0b823ede HTTP/1.1" status: 200  len: 710 time: 0.2045155
May 25 16:30:14.958514 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa7eff3d-4d8e-4a34-923a-543741680d23 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:30:14.959851 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-fa7eff3d-4d8e-4a34-923a-543741680d23 admin admin] 10.222.0.73 "GET /v2.0/networks/fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb HTTP/1.1" status: 200  len: 886 time: 0.1242712
May 25 16:30:14.968431 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:30:15.427628 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-501153', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-506985', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2362'] for router, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:15.786388 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:15.818412 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 89f1e80a-f976-48f6-85b7-25e0f36ab49c up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:30:15.843388 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:15.884770 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 89f1e80a-f976-48f6-85b7-25e0f36ab49c completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:30:15.889661 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 89f1e80a-f976-48f6-85b7-25e0f36ab49c triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:30:15.890027 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:16.007513 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:16.041496 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 89f1e80a-f976-48f6-85b7-25e0f36ab49c, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=89f1e80a-f976-48f6-85b7-25e0f36ab49c,segment=NetworkSegment(828e6dc1-8163-4890-ac2b-db9f59737de3),segment_id=828e6dc1-8163-4890-ac2b-db9f59737de3)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:30:16.042022 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Allocated IP 172.27.3.126 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/ffbaa3fd-da1c-4d0f-9634-a85570548dfc) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:30:16.045684 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:16.047799 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-aa3b9cb7-e676-4153-a216-1d00eb017be0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:30:16.135326 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=89f1e80a-f976-48f6-85b7-25e0f36ab49c,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:30:16.138383 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:30:16.190713 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:16.219431 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:16.223891 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-27c2bece-7880-41bb-ac3f-7bbcc6a9f2b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:30:16.288173 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:30:16.290944 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:30:16.298847 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:30:16.349918 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Pushing event updated for resources: {'Port': ['ID=ffbaa3fd-da1c-4d0f-9634-a85570548dfc,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:30:16.361748 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:30:16.679811 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:17.015490 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-501153', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-506985', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2362'] for router, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:17.019199 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-501218', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-501162', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-501227', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-507007'] for router, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:17.196405 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Router 10384943-9e1c-4163-99eb-e01a0b823ede has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:30:17.424954 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:30:17.433215 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Notify callbacks [] for router, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:17.434229 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Sync routers for ids ['10384943-9e1c-4163-99eb-e01a0b823ede'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:30:17.434672 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] 10.222.0.73 "PUT /v2.0/routers/10384943-9e1c-4163-99eb-e01a0b823ede HTTP/1.1" status: 200  len: 890 time: 2.4692276
May 25 16:30:17.444753 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Routers {'10384943-9e1c-4163-99eb-e01a0b823ede'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:30:17.445446 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bb17cd0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:30:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['10384943-9e1c-4163-99eb-e01a0b823ede'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:30:17.638382 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Set router 10384943-9e1c-4163-99eb-e01a0b823ede gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:30:17.818426 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 89f1e80a-f976-48f6-85b7-25e0f36ab49c up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:30:17.980430 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 89f1e80a-f976-48f6-85b7-25e0f36ab49c triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:30:17.980710 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:18.159874 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bb17cd0>, [{'id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'name': 'router1', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.126'}], 'enable_snat': True}, 'gw_port_id': 'ffbaa3fd-da1c-4d0f-9634-a85570548dfc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:29:58Z', 'updated_at': '2021-05-25T16:30:16Z', 'revision_number': 4, 'project_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'gw_port': {'id': 'ffbaa3fd-da1c-4d0f-9634-a85570548dfc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:8f:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.126', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:30:15Z', 'updated_at': '2021-05-25T16:30:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '89f1e80a-f976-48f6-85b7-25e0f36ab49c', 'name': '', 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'mac_address': 'fa:16:3e:5a:7d:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'b2ccc23b-f7d7-4620-b322-657a01777ce0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:30:07Z', 'updated_at': '2021-05-25T16:30:16Z', 'revision_number': 5, 'project_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'subnets': [{'id': 'b2ccc23b-f7d7-4620-b322-657a01777ce0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '8eedbd88-7e47-4e40-b894-e3b7da7b7e01'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:30:18.164859 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Checking router: 10384943-9e1c-4163-99eb-e01a0b823ede for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:30:18.165216 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Updating router 10384943-9e1c-4163-99eb-e01a0b823ede port ffbaa3fd-da1c-4d0f-9634-a85570548dfc binding host dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:30:18.218077 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:18.546226 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Notify callbacks [] for port, precommit_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:18.557641 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Transition to ACTIVE for port object ffbaa3fd-da1c-4d0f-9634-a85570548dfc will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:30:18.564150 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:18.568138 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-99a92536-a5ca-4b77-86d7-fea6c24bc1a9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:30:18.647202 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Attempting to bind port ffbaa3fd-da1c-4d0f-9634-a85570548dfc on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:30:18.647570 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Attempting to bind port ffbaa3fd-da1c-4d0f-9634-a85570548dfc by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:30:18.647933 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Attempting to bind port ffbaa3fd-da1c-4d0f-9634-a85570548dfc on network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:30:18.655097 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c56a70b-947d-4d72-a552-1e96ace4a40f None None] Pushing event updated for resources: {'Port': ['ID=ffbaa3fd-da1c-4d0f-9634-a85570548dfc,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:30:18.657544 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 30, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:30:18.657978 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Checking segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:30:18.658677 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:18.658787 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Bound using segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:30:18.659273 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Bound port: ffbaa3fd-da1c-4d0f-9634-a85570548dfc, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:30:18.659643 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:18.682954 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-5c56a70b-947d-4d72-a552-1e96ace4a40f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:30:18.732705 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] For port ffbaa3fd-da1c-4d0f-9634-a85570548dfc, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:30:18.735982 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] For port ffbaa3fd-da1c-4d0f-9634-a85570548dfc, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=ffbaa3fd-da1c-4d0f-9634-a85570548dfc,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:30:18.739695 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:18.743352 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:30:18.822445 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Routers {'10384943-9e1c-4163-99eb-e01a0b823ede'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:30:18.823043 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bb17cd0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:30:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['10384943-9e1c-4163-99eb-e01a0b823ede'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:30:18.869556 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c56a70b-947d-4d72-a552-1e96ace4a40f None None] Pushing event updated for resources: {'Port': ['ID=ffbaa3fd-da1c-4d0f-9634-a85570548dfc,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:30:18.877880 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-5c56a70b-947d-4d72-a552-1e96ace4a40f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:30:19.026244 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] Set router 10384943-9e1c-4163-99eb-e01a0b823ede gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:30:19.360162 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bb17cd0>, [{'id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'name': 'router1', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.126'}], 'enable_snat': True}, 'gw_port_id': 'ffbaa3fd-da1c-4d0f-9634-a85570548dfc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:29:58Z', 'updated_at': '2021-05-25T16:30:16Z', 'revision_number': 4, 'project_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'gw_port': {'id': 'ffbaa3fd-da1c-4d0f-9634-a85570548dfc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:8f:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.126', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:30:15Z', 'updated_at': '2021-05-25T16:30:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '89f1e80a-f976-48f6-85b7-25e0f36ab49c', 'name': '', 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'mac_address': 'fa:16:3e:5a:7d:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'b2ccc23b-f7d7-4620-b322-657a01777ce0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:30:07Z', 'updated_at': '2021-05-25T16:30:16Z', 'revision_number': 5, 'project_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'subnets': [{'id': 'b2ccc23b-f7d7-4620-b322-657a01777ce0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '8eedbd88-7e47-4e40-b894-e3b7da7b7e01'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:30:19.364766 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9238f6d-2e98-4533-bec4-dc7f4ad00fbd None None] The sync data for ids ['10384943-9e1c-4163-99eb-e01a0b823ede'] in dv-cinder-786386-6-iscsi is: [{'id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'name': 'router1', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.126'}], 'enable_snat': True}, 'gw_port_id': 'ffbaa3fd-da1c-4d0f-9634-a85570548dfc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:29:58Z', 'updated_at': '2021-05-25T16:30:16Z', 'revision_number': 4, 'project_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'gw_port': {'id': 'ffbaa3fd-da1c-4d0f-9634-a85570548dfc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:8f:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.126', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:30:15Z', 'updated_at': '2021-05-25T16:30:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '89f1e80a-f976-48f6-85b7-25e0f36ab49c', 'name': '', 'network_id': '8686733d-7a46-4e4f-9691-3e62118c507c', 'tenant_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'mac_address': 'fa:16:3e:5a:7d:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10384943-9e1c-4163-99eb-e01a0b823ede', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'b2ccc23b-f7d7-4620-b322-657a01777ce0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:30:07Z', 'updated_at': '2021-05-25T16:30:16Z', 'revision_number': 5, 'project_id': 'bc01a6db705b4bef9240c34ace7c4d7b', 'subnets': [{'id': 'b2ccc23b-f7d7-4620-b322-657a01777ce0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '8eedbd88-7e47-4e40-b894-e3b7da7b7e01'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:30:19.807422 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 49012) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:30:19.854525 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device ffbaa3fd-da1c-4d0f-9634-a85570548dfc up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:30:19.938255 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port ffbaa3fd-da1c-4d0f-9634-a85570548dfc completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:30:19.953461 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port ffbaa3fd-da1c-4d0f-9634-a85570548dfc triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:30:19.953461 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:19.955341 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-a89e1822-76a8-472a-a18b-638554015c57 admin admin] 10.222.0.73 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 411 time: 0.1466942
May 25 16:30:20.096507 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:20.116243 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port ffbaa3fd-da1c-4d0f-9634-a85570548dfc, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=ffbaa3fd-da1c-4d0f-9634-a85570548dfc,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:30:20.124341 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:20.124341 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:30:20.204693 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=ffbaa3fd-da1c-4d0f-9634-a85570548dfc,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:30:20.209082 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:30:21.810162 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device ffbaa3fd-da1c-4d0f-9634-a85570548dfc up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:30:21.898104 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port ffbaa3fd-da1c-4d0f-9634-a85570548dfc triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:30:21.898474 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:24.479754 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 5 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:30:31.355285 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-ed19b744-b63e-4d7a-938c-5edcd97da941 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:33.789814 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:34.094622 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-24f10202-361a-4cf8-9f45-0d2649df9952 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:34.994760 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:30:36.507672 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:31:01.359714 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b2dcd6e5-a5a2-4d22-a2f7-933c0dd165fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:31:01.485253 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 5 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:31:03.801216 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:31:04.083408 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-68899a7f-b3fd-4c9d-a503-6d5f3e091bce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:31:04.984663 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:31:06.495309 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:31:31.363575 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-269802b4-3f62-402d-82e9-b0986ca39bfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:31:33.794742 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:31:34.077556 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-0ea3208e-b873-49e8-9ed9-1c3828639c5f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:31:34.987522 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:31:36.492764 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:31:38.483893 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 5 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:31:57.726098 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49582) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:31:57.803880 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.pecan_wsgi.hooks.translation [None req-eecf2eae-189e-4598-aa30-2db8a6502a2f admin admin] GET failed (client error): The resource could not be found.
May 25 16:31:57.804419 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-eecf2eae-189e-4598-aa30-2db8a6502a2f admin admin] Synchronizing usage tracker for tenant:281b87fe66334a1497a5f10f0bcc68bc on resource:network {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:31:57.822591 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-eecf2eae-189e-4598-aa30-2db8a6502a2f admin admin] Unset dirty status for tenant:281b87fe66334a1497a5f10f0bcc68bc on resource:network {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:31:57.823640 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-eecf2eae-189e-4598-aa30-2db8a6502a2f admin admin] 10.222.0.73 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0965714
May 25 16:31:57.975428 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a405155b-62be-4fc3-8671-7488730c597f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:31:57.976891 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-a405155b-62be-4fc3-8671-7488730c597f admin admin] 10.222.0.73 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 872 time: 0.1493018
May 25 16:32:00.197708 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49592) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:32:00.326907 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d10a9f2-f95d-42c4-8ef5-08c26f10b96d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:00.329076 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-4d10a9f2-f95d-42c4-8ef5-08c26f10b96d admin admin] 10.222.0.73 "GET /v2.0/subnets/b2ccc23b-f7d7-4620-b322-657a01777ce0 HTTP/1.1" status: 200  len: 849 time: 0.1301558
May 25 16:32:00.339491 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:32:00.481193 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Notify callbacks [] for subnet, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:00.690453 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8741446402205'] for subnet, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:00.694990 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:32:00.740121 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:00.740121 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:00.753447 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] 10.222.0.73 "PUT /v2.0/subnets/b2ccc23b-f7d7-4620-b322-657a01777ce0 HTTP/1.1" status: 200  len: 868 time: 0.4061177
May 25 16:32:00.753728 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0acba6dd-2469-4b49-bc94-7baa1276fe0f None None] Network 8686733d-7a46-4e4f-9691-3e62118c507c requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:32:00.772804 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Pushing event updated for resources: {'Subnet': ['ID=b2ccc23b-f7d7-4620-b322-657a01777ce0,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:32:00.781578 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:00.782103 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:00.782472 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:00.783074 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:00.783399 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:00.783734 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:00.784050 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:00.784360 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:00.784685 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:00.785148 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:00.785485 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:00.785791 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:00.791896 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:32:01.270831 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-1fe4af0e-ea18-4d87-b0f8-a19167668978 None None] Provisioning complete for port b4e1496d-df11-4337-a227-6cf7ed33f211 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:32:01.271367 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-1fe4af0e-ea18-4d87-b0f8-a19167668978 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:01.439781 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-48ada7f1-102d-4335-a893-ab6686326ce3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:01.459644 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-1fe4af0e-ea18-4d87-b0f8-a19167668978 None None] Provisioning complete for port 89f1e80a-f976-48f6-85b7-25e0f36ab49c triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:32:01.460005 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-1fe4af0e-ea18-4d87-b0f8-a19167668978 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:02.982498 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49602) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:32:03.174880 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a095b5bd-89d3-44b4-a09f-fe6f3b0cd672 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:03.175391 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a095b5bd-89d3-44b4-a09f-fe6f3b0cd672 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:03.176943 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-a095b5bd-89d3-44b4-a09f-fe6f3b0cd672 admin admin] 10.222.0.73 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1934934
May 25 16:32:03.799225 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:04.084525 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-abc423b9-b7cf-48c3-87b6-8e3e62f37636 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:04.991448 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:05.426745 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49612) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:32:05.629688 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37b1c09c-6388-42b1-9618-c4ba4b7716b5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:05.630183 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37b1c09c-6388-42b1-9618-c4ba4b7716b5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:05.631723 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-37b1c09c-6388-42b1-9618-c4ba4b7716b5 admin admin] 10.222.0.73 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.2040148
May 25 16:32:06.496215 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:07.996949 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49622) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:32:08.199959 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01cd608a-f55a-4d26-967b-1b7b02113acf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:08.201330 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-01cd608a-f55a-4d26-967b-1b7b02113acf admin admin] 10.222.0.73 "GET /v2.0/networks/8686733d-7a46-4e4f-9691-3e62118c507c HTTP/1.1" status: 200  len: 869 time: 0.2034149
May 25 16:32:10.434969 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 49632) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:32:10.605945 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19867b4f-3ae8-43da-8c34-37b05c57aa22 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:10.607288 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-19867b4f-3ae8-43da-8c34-37b05c57aa22 admin admin] 10.222.0.73 "GET /v2.0/networks/fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb HTTP/1.1" status: 200  len: 886 time: 0.1713486
May 25 16:32:12.831359 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49642) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:32:12.961421 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-238f9c0c-88c3-4c3a-94d5-10f849793238 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:12.961950 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-238f9c0c-88c3-4c3a-94d5-10f849793238 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:12.963863 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-238f9c0c-88c3-4c3a-94d5-10f849793238 admin admin] 10.222.0.73 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1313241
May 25 16:32:15.114807 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49652) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:32:15.255694 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63bc6200-fc90-488e-8c21-7e5499fbb051 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:15.256228 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63bc6200-fc90-488e-8c21-7e5499fbb051 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:15.257901 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-63bc6200-fc90-488e-8c21-7e5499fbb051 admin admin] 10.222.0.73 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1422334
May 25 16:32:15.484922 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 5 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:32:17.644515 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49662) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:32:17.758388 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88eabd83-f88e-4e49-a01a-27c2ba5ccbcb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:17.759822 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-88eabd83-f88e-4e49-a01a-27c2ba5ccbcb admin admin] 10.222.0.73 "GET /v2.0/subnets/772b799b-fb95-46a6-ab51-ab34127985e2 HTTP/1.1" status: 200  len: 816 time: 0.1143315
May 25 16:32:20.230946 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49672) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:32:20.366642 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3ef2518-6982-4c09-aada-5d4d735fec8a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:20.368074 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-a3ef2518-6982-4c09-aada-5d4d735fec8a admin admin] 10.222.0.73 "GET /v2.0/subnets/b2ccc23b-f7d7-4620-b322-657a01777ce0 HTTP/1.1" status: 200  len: 868 time: 0.1361330
May 25 16:32:31.363513 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-ae26cc87-b028-466b-b45e-288b9a39cb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:33.807706 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:34.079129 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8aa79267-19f8-4820-bf89-b27e423a3cc5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:34.993778 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:36.591079 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:44.401496 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49716) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:32:44.452623 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [None req-dbf29d7f-2aef-439b-8e11-d06884a8b8cf admin admin] http://10.222.0.73:9696/v2.0/extensions returned with HTTP 200 {{(pid=92013) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 16:32:44.454428 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-dbf29d7f-2aef-439b-8e11-d06884a8b8cf admin admin] 10.222.0.73 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0517826
May 25 16:32:46.759540 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49726) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:32:46.851502 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.pecan_wsgi.hooks.translation [None req-42c59df2-c49e-4702-9a44-5e18db38984b admin admin] GET failed (client error): The resource could not be found.
May 25 16:32:46.853815 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-42c59df2-c49e-4702-9a44-5e18db38984b admin admin] 10.222.0.73 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0924103
May 25 16:32:47.029726 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bac9c238-ac19-48e0-9e69-0bf18106512d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:47.031583 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-bac9c238-ac19-48e0-9e69-0bf18106512d admin admin] 10.222.0.73 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1719551
May 25 16:32:49.286763 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 49736) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:32:49.335993 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'shared', 'shared': True}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:32:49.340408 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:32:49.352428 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:32:49.363264 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Made reservation on behalf of 281b87fe66334a1497a5f10f0bcc68bc for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:32:49.365629 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:49.452900 dv-cinder-786386-6-iscsi neutron-server[92012]: WARNING neutron.services.revisions.revision_plugin [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7f346b0c7190] {project_id='281b87fe66334a1497a5f10f0bcc68bc', id='cba0274c-79c7-44ec-8917-6de42f7aca5c', target_tenant='*', action='access_as_shared', object_id='1235741b-b9bd-40c7-a0a4-63bc412a6700'}> to bump revision.
May 25 16:32:49.465305 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 415}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:32:49.475672 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:49.476011 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Added segment 1f2c9fdf-ae4e-491a-b3be-e5a8b549664a of type vlan for network 1235741b-b9bd-40c7-a0a4-63bc412a6700
May 25 16:32:49.502289 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:49.531475 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:49.533118 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:49.533880 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:49.537969 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:32:49.642313 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Pushing event updated for resources: {'Network': ['ID=1235741b-b9bd-40c7-a0a4-63bc412a6700,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:32:49.646786 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.3590021
May 25 16:32:49.650731 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:49.651092 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:49.651423 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:49.651736 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:49.652057 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:49.652393 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:49.652711 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:49.653025 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:49.653360 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:49.653831 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:49.654046 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:49.654985 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:49.659885 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:32:49.669944 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network 1235741b-b9bd-40c7-a0a4-63bc412a6700 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:32:51.855984 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49746) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:32:51.925280 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.pecan_wsgi.hooks.translation [None req-be0e984d-e915-4095-9179-0dbe67eaa871 admin admin] GET failed (client error): The resource could not be found.
May 25 16:32:51.926659 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-be0e984d-e915-4095-9179-0dbe67eaa871 admin admin] 10.222.0.73 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.0697579
May 25 16:32:52.034534 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4ad8965-b4a0-4846-9389-5a375d6af12e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:52.036002 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-e4ad8965-b4a0-4846-9389-5a375d6af12e admin admin] 10.222.0.73 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 826 time: 0.1052139
May 25 16:32:52.045361 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Request body: {'subnet': {'description': 'shared-subnet', 'network_id': '1235741b-b9bd-40c7-a0a4-63bc412a6700', 'ip_version': 4, 'cidr': '192.168.233.0/24', 'name': 'shared-subnet'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:32:52.049773 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:32:52.053604 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Usage tracker for resource:subnet and tenant:281b87fe66334a1497a5f10f0bcc68bc is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:32:52.056863 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Quota usage for subnet was recalculated. Used quota:1. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:32:52.062725 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:32:52.072161 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Made reservation on behalf of 281b87fe66334a1497a5f10f0bcc68bc for: {'subnet': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:32:52.074371 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:52.490895 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 5 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:32:52.542329 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852'] for subnet, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:52.547191 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-b5915051-3434-4ca7-b809-f3859605edfb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:32:52.635418 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3c2b6433-203d-442f-b9b1-64f968f23228,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:32:52.639582 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:32:52.642906 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Checking segment: {'id': '1f2c9fdf-ae4e-491a-b3be-e5a8b549664a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 415, 'network_id': '1235741b-b9bd-40c7-a0a4-63bc412a6700'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:32:52.643334 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Network hostable DHCP agents. Network: 1235741b-b9bd-40c7-a0a4-63bc412a6700, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92013) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:32:52.666363 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Network 1235741b-b9bd-40c7-a0a4-63bc412a6700 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92013) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:32:52.677588 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, 1235741b-b9bd-40c7-a0a4-63bc412a6700) {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:32:52.683132 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:32:52.684014 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:52.692964 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58946dd8-de29-4717-a925-be52da1a9977 None None] Network 1235741b-b9bd-40c7-a0a4-63bc412a6700 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:32:52.709971 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.6677263
May 25 16:32:52.921132 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d60576c-5158-50e8-99d6-6272b1af5e3f-1235741b-b9bd-40c7-a0a4-63bc412a6700', 'network_id': '1235741b-b9bd-40c7-a0a4-63bc412a6700', 'tenant_id': '281b87fe66334a1497a5f10f0bcc68bc', 'fixed_ips': [{'subnet_id': '3c2b6433-203d-442f-b9b1-64f968f23228'}]}} from dv-cinder-786386-6-iscsi. {{(pid=92014) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 16:32:52.922160 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:53.134766 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.db_base_plugin_common [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Allocated IP 192.168.233.2 (1235741b-b9bd-40c7-a0a4-63bc412a6700/3c2b6433-203d-442f-b9b1-64f968f23228/1d611278-c45d-47db-8277-6c0a1172e645) {{(pid=92014) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:32:53.366141 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Notify callbacks [] for port, precommit_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:53.377388 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Transition to ACTIVE for port object 1d611278-c45d-47db-8277-6c0a1172e645 will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:32:53.400591 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Transition to ACTIVE for port object 1d611278-c45d-47db-8277-6c0a1172e645 will not be triggered until provisioned by entity DHCP. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:32:53.406922 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:53.412926 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-5c56a70b-947d-4d72-a552-1e96ace4a40f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:32:53.481129 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Network 1235741b-b9bd-40c7-a0a4-63bc412a6700 is already hosted by enough agents. {{(pid=92014) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:32:53.484435 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.base_scheduler [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Resources bound (agent type, host, resource id):  {{(pid=92014) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:32:53.489094 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Pushing event updated for resources: {'Port': ['ID=1d611278-c45d-47db-8277-6c0a1172e645,revision_number=1']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:32:53.491568 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Received port after_create {{(pid=92014) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:32:53.503300 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:53.503747 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:53.504095 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:53.504454 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:53.504777 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:53.505877 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:53.505877 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:53.505877 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:53.506604 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:53.506604 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:53.506820 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:53.507188 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:32:53.535562 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:32:53.601951 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Attempting to bind port 1d611278-c45d-47db-8277-6c0a1172e645 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:32:53.602324 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Attempting to bind port 1d611278-c45d-47db-8277-6c0a1172e645 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '1f2c9fdf-ae4e-491a-b3be-e5a8b549664a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 415, 'network_id': '1235741b-b9bd-40c7-a0a4-63bc412a6700'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:32:53.602717 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Attempting to bind port 1d611278-c45d-47db-8277-6c0a1172e645 on network 1235741b-b9bd-40c7-a0a4-63bc412a6700 {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:32:53.609688 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 32, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:32:53.610062 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Checking segment: {'id': '1f2c9fdf-ae4e-491a-b3be-e5a8b549664a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 415, 'network_id': '1235741b-b9bd-40c7-a0a4-63bc412a6700'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:32:53.610493 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:53.610891 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Bound using segment: {'id': '1f2c9fdf-ae4e-491a-b3be-e5a8b549664a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 415, 'network_id': '1235741b-b9bd-40c7-a0a4-63bc412a6700'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:32:53.611357 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Bound port: 1d611278-c45d-47db-8277-6c0a1172e645, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1f2c9fdf-ae4e-491a-b3be-e5a8b549664a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 415, 'network_id': '1235741b-b9bd-40c7-a0a4-63bc412a6700'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:32:53.611730 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:53.707970 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] For port 1d611278-c45d-47db-8277-6c0a1172e645, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:32:53.711435 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] For port 1d611278-c45d-47db-8277-6c0a1172e645, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=1d611278-c45d-47db-8277-6c0a1172e645,segment=NetworkSegment(1f2c9fdf-ae4e-491a-b3be-e5a8b549664a),segment_id=1f2c9fdf-ae4e-491a-b3be-e5a8b549664a)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:32:53.717846 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:53.725686 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:32:53.804629 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Pushing event updated for resources: {'Port': ['ID=1d611278-c45d-47db-8277-6c0a1172e645,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:32:53.808147 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:32:54.644117 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e00510b-39be-4a63-9616-8da89c52ebf5 None None] Network 1235741b-b9bd-40c7-a0a4-63bc412a6700 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:32:54.744085 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-97e03b43-c7cb-484f-acb7-87f2d36b345b None None] Provisioning for port 1d611278-c45d-47db-8277-6c0a1172e645 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:32:55.950502 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 1d611278-c45d-47db-8277-6c0a1172e645 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:32:56.023472 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 1d611278-c45d-47db-8277-6c0a1172e645 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:32:56.028343 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 1d611278-c45d-47db-8277-6c0a1172e645 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:32:56.028711 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:56.171289 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:56.204871 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 1d611278-c45d-47db-8277-6c0a1172e645, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=1d611278-c45d-47db-8277-6c0a1172e645,segment=NetworkSegment(1f2c9fdf-ae4e-491a-b3be-e5a8b549664a),segment_id=1f2c9fdf-ae4e-491a-b3be-e5a8b549664a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:32:56.209051 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:32:56.211478 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:32:56.279818 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=1d611278-c45d-47db-8277-6c0a1172e645,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:32:56.283088 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:32:57.930883 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 1d611278-c45d-47db-8277-6c0a1172e645 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:32:58.003258 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 1d611278-c45d-47db-8277-6c0a1172e645 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:32:58.003621 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:33:01.366039 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-5aa0761d-8282-430f-a01f-78160b0f5f13 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:33:03.801446 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:33:04.080489 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-3f26ecd3-f055-43f2-92f7-51d9743663d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:33:05.007399 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:33:06.505243 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:33:29.493068 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 5 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:33:31.377179 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-505ea212-83da-4940-95c3-4652313d10e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:33:33.806971 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:33:34.084560 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b2445b46-d126-429f-8647-aca1d4aba88a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:33:34.999463 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:33:36.510324 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:01.371321 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-ad5bbe18-88b1-46e6-8cea-852f1dbb580e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:03.811394 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:04.086230 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2f3dc625-9a56-4df4-bda9-d395bc1acfde None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:04.824848 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49796) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:34:04.830739 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [None req-e10d2aa8-d62e-477e-9f97-a7e617ea88e9 tempest-verify_tempest_config-1997882847 tempest-verify_tempest_config-1997882847-project] http://10.222.0.73:9696/v2.0/extensions returned with HTTP 200 {{(pid=92013) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 16:34:04.831657 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-e10d2aa8-d62e-477e-9f97-a7e617ea88e9 tempest-verify_tempest_config-1997882847 tempest-verify_tempest_config-1997882847-project] 10.222.0.73 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0058424
May 25 16:34:05.001684 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:05.140851 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49814) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:34:05.258344 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:05.274676 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:34:05.278704 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Usage tracker for resource:security_group_rule and tenant:6f890e04d2c742b39150bdc392c4b346 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:34:05.281744 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:34:05.287549 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:34:05.374123 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:05.378317 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:05.386202 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:34:05.427021 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a8deee47-45a6-4c26-8d7c-c955fd9c2872,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:34:05.430280 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Synchronizing usage tracker for tenant:281b87fe66334a1497a5f10f0bcc68bc on resource:security_group {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:34:05.441626 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:34:05.441989 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:34:05.442321 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:34:05.442642 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:34:05.442965 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:34:05.443296 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:34:05.443618 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:34:05.443928 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:34:05.444259 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:34:05.444571 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:34:05.444878 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:34:05.445183 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:34:05.450495 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:34:05.459740 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Unset dirty status for tenant:281b87fe66334a1497a5f10f0bcc68bc on resource:security_group {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:34:05.463372 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=6f890e04d2c742b39150bdc392c4b346&name=default HTTP/1.1" status: 200  len: 2975 time: 0.3191814
May 25 16:34:05.463591 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49820) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:34:05.524558 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ebf9ccef-1511-4e37-9d83-fab451b30bac admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:05.554670 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ebf9ccef-1511-4e37-9d83-fab451b30bac admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:05.664205 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ebf9ccef-1511-4e37-9d83-fab451b30bac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:05.668362 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:34:05.682623 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebf9ccef-1511-4e37-9d83-fab451b30bac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8deee47-45a6-4c26-8d7c-c955fd9c2872,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:34:05.686372 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ebf9ccef-1511-4e37-9d83-fab451b30bac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:34:05.688357 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ebf9ccef-1511-4e37-9d83-fab451b30bac admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:05.689506 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-ebf9ccef-1511-4e37-9d83-fab451b30bac admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/a8deee47-45a6-4c26-8d7c-c955fd9c2872 HTTP/1.1" status: 204  len: 168 time: 0.2249639
May 25 16:34:06.496388 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 5 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:34:06.511155 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:31.376588 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-0b3e70f9-b70e-4c50-ae10-6bb9f08b3cf6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:33.817473 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:34.092262 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-9296a3ca-76ba-4223-8f60-5571f39f00e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:35.006889 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:36.513954 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:34:43.494801 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 5 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:35:01.380894 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-a572d29f-6bb7-4fd9-a109-db669dc0430e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:35:03.811095 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:35:04.085279 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-68fe0d7b-c974-4a16-b2f0-b48c0d2fce33 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:35:05.005941 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:35:06.515529 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:35:20.493985 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 5 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:35:31.383024 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-aa8e4203-1c83-4e65-820d-bbb6a157e031 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:35:33.813535 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:35:34.090252 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7cfffbab-c649-497e-9dfc-50e6fde91f14 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:35:35.011902 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:35:36.517989 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:35:41.201651 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190'] for agent, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:35:45.688618 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49872) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:35:45.807321 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-4be8791a-d356-423c-8359-f357378d11e9 admin admin] 10.222.0.73 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.1175992
May 25 16:35:48.021827 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 49882) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:35:48.081791 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-11822702-ecd4-4b8e-adcd-a0e1f61f28c7 admin admin] 10.222.0.73 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.0588493
May 25 16:35:57.492722 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:36:01.385566 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-e5228ce8-3c75-43c7-aaeb-ab85e64102f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:36:03.816569 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:36:04.092509 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b0b1ad3a-f8e5-4d8a-9340-7c5f1fb29a8b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:36:05.012918 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:36:06.526675 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:36:11.171756 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:36:31.388481 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-1e33bf52-0125-46e7-8447-3110ebee5a30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:36:33.828184 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:36:34.095689 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-10a4c78a-05bf-4dfa-92aa-5ab48c40ad6a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:36:34.492107 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:36:35.015932 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:36:36.524099 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:36:41.172638 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:01.389866 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-447a0b9a-2854-463a-b00e-4566bc0bf49c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:03.822660 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:04.098068 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2847c584-8ef8-4a2c-9e04-c4b19b15cec6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:05.019554 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:06.536539 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:11.182941 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:11.491943 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:37:15.894776 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 50090) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:16.363203 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1213932814-network', 'tenant_id': '63f896ab0d7e44158204551033c33ba4'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:16.367683 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:16.372064 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Usage tracker for resource:network and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:16.375743 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:16.381578 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:16.391842 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Made reservation on behalf of 63f896ab0d7e44158204551033c33ba4 for: {'network': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:16.394814 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:16.407286 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:16.422617 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:16.426423 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Usage tracker for resource:security_group_rule and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:16.429627 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:16.436323 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:16.471133 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50118) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:16.510611 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50124) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:16.529896 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:16.534707 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:16.542999 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:16.563483 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 430}  {{(pid=92013) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:37:16.563584 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50138) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:16.576083 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:16.576772 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.segments_db [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Added segment d81e37c9-589a-4925-890a-a746a946e185 of type vlan for network ce683266-622a-4b13-a610-301441bf2882
May 25 16:37:16.603811 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ace2ae0-ee6e-415e-a65a-ca8b6ff8de8f,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:16.629854 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:16.630187 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:16.630701 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:16.631025 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:16.631370 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:16.631691 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:16.632006 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:16.632317 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:16.632631 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:16.632941 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:16.633246 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:16.634721 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Tracked resource versions report:
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]: pushed versions:
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]: {   'AddressGroup': {'1.2'},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     'ConntrackHelper': {'1.0'},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     'Log': {'1.0'},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     'Network': {'1.1'},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     'Port': {'1.7'},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     'PortForwarding': {'1.2'},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     'QosPolicy': {'1.8'},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     'SecurityGroup': {'1.4'},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     'SecurityGroupRule': {'1.2'},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     'SubPort': {'1.0'},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     'Subnet': {'1.1'},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     'Trunk': {'1.1'}}
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]: consumer versions:
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]: {   DHCP agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     HyperV agent@hv-cinder-78638: {},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     L3 agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     Metadata agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     Metering agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:     Open vSwitch agent@dv-cinder-786386-6-iscsi: {   'AddressGroup': '1.2',
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'ConntrackHelper': '1.0',
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'Log': '1.0',
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'Network': '1.1',
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'Port': '1.7',
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'PortForwarding': '1.2',
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'QosPolicy': '1.8',
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'SecurityGroup': '1.4',
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'SecurityGroupRule': '1.2',
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'SubPort': '1.0',
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'Subnet': '1.1',
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:                                                      'Trunk': '1.1'}}
May 25 16:37:16.635858 dv-cinder-786386-6-iscsi neutron-server[92013]:  {{(pid=92013) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 16:37:16.639775 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:16.663549 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:16.674532 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:16.675707 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:16.676283 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:16.681926 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:16.708835 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50144) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:16.778266 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Pushing event updated for resources: {'Network': ['ID=ce683266-622a-4b13-a610-301441bf2882,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:16.782694 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:16.790808 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network ce683266-622a-4b13-a610-301441bf2882 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:37:16.810062 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50150) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:16.810764 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.9149256
May 25 16:37:16.819369 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Request body: {'subnet': {'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1213932814-subnet', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:16.826910 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:16.832822 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Usage tracker for resource:subnet and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:16.837383 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:16.844652 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:16.871579 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-761141931-network', 'tenant_id': '8db80d29cff3449ea1aaeeeca73788bc'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:16.877658 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:16.882945 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Usage tracker for resource:network and tenant:8db80d29cff3449ea1aaeeeca73788bc is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:16.887601 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:16.900143 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:16.918737 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-388113834-network', 'tenant_id': '2441ab18acee4d4c9e276ba69a458348'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:16.921937 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Made reservation on behalf of 63f896ab0d7e44158204551033c33ba4 for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:16.924531 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:17.035497 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-32259621-network', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:17.051852 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Made reservation on behalf of 8db80d29cff3449ea1aaeeeca73788bc for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:17.054489 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:17.066221 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-235580074-network', 'tenant_id': '5d60da5ade5b4981948179f148ef1f56'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:17.074886 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:17.078840 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:17.085090 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:17.089371 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Usage tracker for resource:network and tenant:5d60da5ade5b4981948179f148ef1f56 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:17.095140 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:17.101117 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Usage tracker for resource:network and tenant:2441ab18acee4d4c9e276ba69a458348 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:17.104598 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:17.113508 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:17.117655 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:17.124798 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Usage tracker for resource:network and tenant:fe57668427364ea7acb08a0f7f2826ed is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:17.135821 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:17.137902 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:17.178714 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Made reservation on behalf of 5d60da5ade5b4981948179f148ef1f56 for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:17.181518 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:17.199280 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:17.203736 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:17.210939 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:17.237392 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:17.246462 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Usage tracker for resource:security_group_rule and tenant:8db80d29cff3449ea1aaeeeca73788bc is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:17.257262 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Usage tracker for resource:security_group_rule and tenant:5d60da5ade5b4981948179f148ef1f56 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:17.264250 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:17.268328 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Made reservation on behalf of 2441ab18acee4d4c9e276ba69a458348 for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:17.271246 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:17.283326 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:17.295669 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:17.300025 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:17.302427 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Made reservation on behalf of fe57668427364ea7acb08a0f7f2826ed for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:17.305248 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:17.322491 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:17.367540 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:17.410315 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:17.456303 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:17.479829 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Usage tracker for resource:security_group_rule and tenant:2441ab18acee4d4c9e276ba69a458348 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:17.500107 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:17.552878 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Usage tracker for resource:security_group_rule and tenant:fe57668427364ea7acb08a0f7f2826ed is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:17.558195 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:17.582153 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:17.584467 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:17.858113 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:17.877236 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:17.896733 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:17.903919 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:17.932253 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:17.986440 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 416}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:37:18.015248 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.020203 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.038459 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 421}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:37:18.042937 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.044643 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.051706 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7890e1c5-3e8a-4733-85ef-97ebc2df58f0,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:18.055050 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.056317 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Added segment b1e2e8a0-c79b-42fe-a4d3-171a8ed15717 of type vlan for network 48fa5bbf-9d42-4b66-8b53-a15b499d3d14
May 25 16:37:18.079949 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:18.080615 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:18.081303 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:18.081990 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:18.082543 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:18.083085 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:18.083622 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:18.084156 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:18.084698 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:18.085221 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:18.085774 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:18.086425 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Tracked resource versions report:
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]: pushed versions:
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]: {   'AddressGroup': {'1.2'},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     'ConntrackHelper': {'1.0'},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     'Log': {'1.0'},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     'Network': {'1.1'},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     'Port': {'1.7'},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     'PortForwarding': {'1.2'},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     'QosPolicy': {'1.8'},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     'SecurityGroup': {'1.4'},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     'SecurityGroupRule': {'1.2'},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     'SubPort': {'1.0'},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     'Subnet': {'1.1'},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     'Trunk': {'1.1'}}
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]: consumer versions:
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]: {   DHCP agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     HyperV agent@hv-cinder-78638: {},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     L3 agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     Metadata agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     Metering agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:     Open vSwitch agent@dv-cinder-786386-6-iscsi: {   'AddressGroup': '1.2',
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'ConntrackHelper': '1.0',
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'Log': '1.0',
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'Network': '1.1',
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'Port': '1.7',
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'PortForwarding': '1.2',
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'QosPolicy': '1.8',
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'SecurityGroup': '1.4',
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'SecurityGroupRule': '1.2',
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'SubPort': '1.0',
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'Subnet': '1.1',
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:                                                      'Trunk': '1.1'}}
May 25 16:37:18.087759 dv-cinder-786386-6-iscsi neutron-server[92012]:  {{(pid=92012) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 16:37:18.102999 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.105955 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Added segment b7ca3982-a156-48a4-94a1-419aff666ce0 of type vlan for network 9705c593-9c13-4e4b-be01-144bdc52bae4
May 25 16:37:18.137548 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:18.138421 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:18.221497 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 403}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:37:18.277481 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 410}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:37:18.289739 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.318319 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.324654 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.324999 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Added segment 227f55be-6fbd-4206-b845-6ee4d0737571 of type vlan for network 1186d694-166f-4246-b68b-e7ce60cb0f02
May 25 16:37:18.337857 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.338197 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Added segment d911a8d2-c389-4e64-97ed-8ffeb60c5e38 of type vlan for network e55be10d-206c-4bb4-8273-c9b859b11a42
May 25 16:37:18.350759 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=037b8d79-e49c-4004-9015-cabf92360e90,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:18.432024 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.451307 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.469922 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:18.470496 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.489504 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.504111 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.507311 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=65702db5-e301-4057-a8d9-21523ce3a5da,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:18.587977 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.601498 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:18.602069 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.676176 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de6bed52-54c6-4c94-af8d-ee9ae4bc356c,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:18.690866 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.553s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:18.696063 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.625s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:18.696350 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:18.703116 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.733s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:18.703474 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:18.708580 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-25266f70-bf77-447b-82ef-edcbe38e5ef9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.225s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:18.738723 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.739230 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.787504 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Checking segment: {'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:18.787823 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Network hostable DHCP agents. Network: ce683266-622a-4b13-a610-301441bf2882, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:37:18.804740 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:18.805329 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.809238 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 2.0989149
May 25 16:37:18.813013 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 50218) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:18.818468 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Request body: {'subnet': {'network_id': '48fa5bbf-9d42-4b66-8b53-a15b499d3d14', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-235580074-subnet', 'tenant_id': '5d60da5ade5b4981948179f148ef1f56', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:18.822295 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 897 time: 2.3497851
May 25 16:37:18.823876 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:18.826442 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 50222) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:18.831164 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:18.831311 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Usage tracker for resource:subnet and tenant:5d60da5ade5b4981948179f148ef1f56 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:18.831966 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.839924 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Request body: {'subnet': {'network_id': '9705c593-9c13-4e4b-be01-144bdc52bae4', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-761141931-subnet', 'tenant_id': '8db80d29cff3449ea1aaeeeca73788bc', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:18.843413 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:18.847952 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:18.853860 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fbb144f-ad5a-4cbb-a2e2-a6a6221f843c admin admin] Pushing event updated for resources: {'Network': ['ID=48fa5bbf-9d42-4b66-8b53-a15b499d3d14,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:18.854918 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:18.861980 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 2.2980990
May 25 16:37:18.862812 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50226) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:18.863475 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Usage tracker for resource:subnet and tenant:8db80d29cff3449ea1aaeeeca73788bc is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:18.868416 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:18.869361 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network 48fa5bbf-9d42-4b66-8b53-a15b499d3d14 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:37:18.877754 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:18.882187 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Made reservation on behalf of 5d60da5ade5b4981948179f148ef1f56 for: {'subnet': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:18.882587 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Request body: {'subnet': {'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-388113834-subnet', 'tenant_id': '2441ab18acee4d4c9e276ba69a458348', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:18.885373 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:18.895968 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 890 time: 2.3803091
May 25 16:37:18.941423 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:18.944115 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Network ce683266-622a-4b13-a610-301441bf2882 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:37:18.960123 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50230) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:18.967927 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Usage tracker for resource:subnet and tenant:2441ab18acee4d4c9e276ba69a458348 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:18.975582 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Request body: {'subnet': {'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-32259621-subnet', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:18.980184 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:18.990076 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:18.992769 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:19.002756 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Pushing event updated for resources: {'Network': ['ID=9705c593-9c13-4e4b-be01-144bdc52bae4,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:19.005630 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Usage tracker for resource:subnet and tenant:fe57668427364ea7acb08a0f7f2826ed is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:19.012310 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:19.016274 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.308s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:19.018641 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, ce683266-622a-4b13-a610-301441bf2882) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:19.020391 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-5e41b253-7420-4b3c-b223-94f002d5f770 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.521s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:19.028828 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network 9705c593-9c13-4e4b-be01-144bdc52bae4 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:37:19.043558 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17e2d1fb-1078-4f80-9da7-2e0f15cc0234 None None] Network ce683266-622a-4b13-a610-301441bf2882 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:37:19.052433 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:19.056042 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:19.056629 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:19.065480 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Made reservation on behalf of 8db80d29cff3449ea1aaeeeca73788bc for: {'subnet': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:19.068003 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Notify callbacks [] for subnet, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:19.073117 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Made reservation on behalf of 2441ab18acee4d4c9e276ba69a458348 for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:19.075336 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Notify callbacks [] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:19.178367 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 2.3671930
May 25 16:37:19.179853 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 50238) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:19.186224 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Made reservation on behalf of fe57668427364ea7acb08a0f7f2826ed for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:19.188628 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:19.194935 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:19.219023 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=06161ba6-62a3-443f-9cfb-bccf3f60ad9c,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:19.229468 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:19.233074 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.613s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:19.242331 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:19.251341 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Usage tracker for resource:router and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:19.255847 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:19.282215 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:19.386499 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-506971', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2375'] for router, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:19.388047 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-504667', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-501124', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1593705', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2380'] for router, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:19.451490 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:19.536683 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d60576c-5158-50e8-99d6-6272b1af5e3f-ce683266-622a-4b13-a610-301441bf2882', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c'}]}} from dv-cinder-786386-6-iscsi. {{(pid=92014) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 16:37:19.545581 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:19.703088 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Pushing event updated for resources: {'Network': ['ID=e55be10d-206c-4bb4-8273-c9b859b11a42,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:19.728795 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network e55be10d-206c-4bb4-8273-c9b859b11a42 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:37:19.962337 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Pushing event updated for resources: {'Network': ['ID=1186d694-166f-4246-b68b-e7ce60cb0f02,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:19.969288 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.736s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:19.970586 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 1.156s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:19.970860 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:19.973201 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.db_base_plugin_common [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Allocated IP 172.20.0.2 (ce683266-622a-4b13-a610-301441bf2882/06161ba6-62a3-443f-9cfb-bccf3f60ad9c/e21e5b5b-f759-4197-8593-9926a21b96d8) {{(pid=92014) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:37:19.973991 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 1.133s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:19.974245 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:19.980277 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network 1186d694-166f-4246-b68b-e7ce60cb0f02 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:37:20.158892 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:20.170150 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:20.218492 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852'] for subnet, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:20.287143 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Checking segment: {'id': '227f55be-6fbd-4206-b845-6ee4d0737571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:20.287799 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Network hostable DHCP agents. Network: 1186d694-166f-4246-b68b-e7ce60cb0f02, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:37:20.308722 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:20.349292 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-501153', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-506985', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2362'] for router, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:20.360533 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5e6146eb-31ff-437b-a594-8ddb1d63042e,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:20.364099 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:20.373340 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Network 1186d694-166f-4246-b68b-e7ce60cb0f02 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:37:20.382994 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:20.391296 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:20.424852 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, 1186d694-166f-4246-b68b-e7ce60cb0f02) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:20.430329 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:20.431266 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:20.442972 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-faed82db-3482-44c5-a1f9-c7e6361f9cab None None] Network 1186d694-166f-4246-b68b-e7ce60cb0f02 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:37:20.457159 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Notify callbacks [] for port, precommit_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:20.462482 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 1.5007300
May 25 16:37:20.478899 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50286) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:20.497633 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Checking segment: {'id': 'b1e2e8a0-c79b-42fe-a4d3-171a8ed15717', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 416, 'network_id': '48fa5bbf-9d42-4b66-8b53-a15b499d3d14'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:20.498300 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Network hostable DHCP agents. Network: 48fa5bbf-9d42-4b66-8b53-a15b499d3d14, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92013) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:37:20.498597 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-32259621-router', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:20.501463 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b953f31d-4490-4000-b4a7-9a7cdcd546da,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:20.509383 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:20.517332 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:20.520186 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Pushing event updated for resources: {'Subnet': ['ID=c4c2aef1-f957-410f-9038-a1d13568aa6e,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:20.526977 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Transition to ACTIVE for port object e21e5b5b-f759-4197-8593-9926a21b96d8 will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:37:20.534848 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Usage tracker for resource:router and tenant:fe57668427364ea7acb08a0f7f2826ed is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:20.541736 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:20.551783 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:20.564100 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Transition to ACTIVE for port object e21e5b5b-f759-4197-8593-9926a21b96d8 will not be triggered until provisioned by entity DHCP. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:37:20.569808 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Network 48fa5bbf-9d42-4b66-8b53-a15b499d3d14 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92013) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:37:20.580990 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:20.587709 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:20.592173 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, 48fa5bbf-9d42-4b66-8b53-a15b499d3d14) {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:20.592406 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-506971', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2375'] for router, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:20.604459 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:20.605552 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:20.609477 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-504667', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-501124', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1593705', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2380'] for router, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:20.616396 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:20.641858 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:20.665372 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Network ce683266-622a-4b13-a610-301441bf2882 is already hosted by enough agents. {{(pid=92014) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:37:20.666711 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44fd8812-c2d8-4c76-96bf-73834d285400 None None] Network 48fa5bbf-9d42-4b66-8b53-a15b499d3d14 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:37:20.689112 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.base_scheduler [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Resources bound (agent type, host, resource id):  {{(pid=92014) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:20.711127 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 1.8976469
May 25 16:37:20.731879 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852'] for subnet, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:20.741531 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Received port after_create {{(pid=92014) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:37:20.779319 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Checking segment: {'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:20.779958 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Network hostable DHCP agents. Network: e55be10d-206c-4bb4-8273-c9b859b11a42, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:37:20.827919 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-99bd559f-6495-430b-bd09-a9dc1d0bc668 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:20.864727 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6034495-40dd-42d2-8df0-6ab9cb1cc307 None None] Network 1186d694-166f-4246-b68b-e7ce60cb0f02 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:37:21.020351 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Network e55be10d-206c-4bb4-8273-c9b859b11a42 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:37:21.048731 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Pushing event updated for resources: {'Subnet': ['ID=6b42c049-ad04-4881-b6e0-fa9912cd6889,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:21.060645 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:21.061892 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:21.093841 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Checking segment: {'id': 'b7ca3982-a156-48a4-94a1-419aff666ce0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 421, 'network_id': '9705c593-9c13-4e4b-be01-144bdc52bae4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:21.094219 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Network hostable DHCP agents. Network: 9705c593-9c13-4e4b-be01-144bdc52bae4, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92013) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:37:21.102318 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:21.161349 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Pushing event updated for resources: {'Port': ['ID=e21e5b5b-f759-4197-8593-9926a21b96d8,revision_number=1']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:21.206098 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, e55be10d-206c-4bb4-8273-c9b859b11a42) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:21.207945 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:21.208327 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:21.208665 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:21.208995 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:21.209319 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:21.209674 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:21.209987 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:21.210595 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:21.210715 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:21.213788 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:21.214145 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:21.214461 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Tracked resource versions report:
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]: pushed versions:
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]: {   'AddressGroup': {'1.2'},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     'ConntrackHelper': {'1.0'},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     'Log': {'1.0'},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     'Network': {'1.1'},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     'Port': {'1.7'},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     'PortForwarding': {'1.2'},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     'QosPolicy': {'1.8'},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     'SecurityGroup': {'1.4'},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     'SecurityGroupRule': {'1.2'},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     'SubPort': {'1.0'},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     'Subnet': {'1.1'},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     'Trunk': {'1.1'}}
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]: consumer versions:
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]: {   DHCP agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     HyperV agent@hv-cinder-78638: {},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     L3 agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     Metadata agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     Metering agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:     Open vSwitch agent@dv-cinder-786386-6-iscsi: {   'AddressGroup': '1.2',
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'ConntrackHelper': '1.0',
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'Log': '1.0',
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'Network': '1.1',
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'Port': '1.7',
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'PortForwarding': '1.2',
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'QosPolicy': '1.8',
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'SecurityGroup': '1.4',
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'SecurityGroupRule': '1.2',
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'SubPort': '1.0',
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'Subnet': '1.1',
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:                                                      'Trunk': '1.1'}}
May 25 16:37:21.215552 dv-cinder-786386-6-iscsi neutron-server[92014]:  {{(pid=92014) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 16:37:21.220627 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-501153', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-506985', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2362'] for router, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:21.225107 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-409602c2-8a6c-4bc2-b0e8-f4851bdd90b5 None None] Network e55be10d-206c-4bb4-8273-c9b859b11a42 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:37:21.227918 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Network 9705c593-9c13-4e4b-be01-144bdc52bae4 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92013) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:37:21.236167 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:21.236840 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:21.277124 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.661s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:21.278229 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Attempting to bind port e21e5b5b-f759-4197-8593-9926a21b96d8 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:37:21.278752 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Attempting to bind port e21e5b5b-f759-4197-8593-9926a21b96d8 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:37:21.279340 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Attempting to bind port e21e5b5b-f759-4197-8593-9926a21b96d8 on network ce683266-622a-4b13-a610-301441bf2882 {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:37:21.294417 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, 9705c593-9c13-4e4b-be01-144bdc52bae4) {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:21.295693 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 2.4176679
May 25 16:37:21.301036 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 50318) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:21.316033 dv-cinder-786386-6-iscsi neutron-server[92013]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
May 25 16:37:21.347707 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:21.348590 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:21.358017 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f856351-2321-4bea-9d14-c5c710907512 None None] Network 9705c593-9c13-4e4b-be01-144bdc52bae4 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:37:21.389454 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 37, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:37:21.389817 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Checking segment: {'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:21.390219 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:21.390617 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Bound using segment: {'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:37:21.391116 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Bound port: e21e5b5b-f759-4197-8593-9926a21b96d8, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:37:21.391504 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:21.501437 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 861 time: 2.6617730
May 25 16:37:21.508697 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Allocated IP 172.27.3.55 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/bbc1c5c6-f690-4c0a-8371-dcdace27c48c) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:37:21.577826 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-ea6d45bf-aae6-4008-bba6-8d5997a3ea89 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:21.585366 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-ea6d45bf-aae6-4008-bba6-8d5997a3ea89 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/networks?id=48fa5bbf-9d42-4b66-8b53-a15b499d3d14 HTTP/1.1" status: 200  len: 811 time: 0.2827601
May 25 16:37:21.715737 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-5ef450a4-bf0a-4bac-852e-8119d25d34f2 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/quotas/5d60da5ade5b4981948179f148ef1f56 HTTP/1.1" status: 200  len: 375 time: 0.1294467
May 25 16:37:21.842330 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:21.849293 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-730d51fa-686a-4884-9da8-44332697dc31 None None] Network 48fa5bbf-9d42-4b66-8b53-a15b499d3d14 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:37:21.869831 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:21.875486 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:21.959212 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 50354) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:21.961786 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-080c66d4-86b3-41bf-8550-5727d8254524 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=5d60da5ade5b4981948179f148ef1f56&fields=id HTTP/1.1" status: 200  len: 210 time: 0.2394230
May 25 16:37:21.966408 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:22.037318 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Allocated IP 172.27.3.110 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/ac87ab76-935f-4d0f-8362-43317047f063) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:37:22.093535 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] For port e21e5b5b-f759-4197-8593-9926a21b96d8, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:37:22.142777 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85c66824-7c1c-4aca-8921-9038ef547c47 None None] Network e55be10d-206c-4bb4-8273-c9b859b11a42 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:37:22.162340 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] For port e21e5b5b-f759-4197-8593-9926a21b96d8, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=e21e5b5b-f759-4197-8593-9926a21b96d8,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:37:22.202012 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:22.215179 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-310cf062-b27c-4ae3-b20a-f8ab3f335d99 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:22.216988 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-310cf062-b27c-4ae3-b20a-f8ab3f335d99 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/networks?id=e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 200  len: 814 time: 0.2540934
May 25 16:37:22.223148 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:22.236267 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:22.256195 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:22.303178 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:37:22.311319 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:22.325153 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:37:22.337486 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:22.348653 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0948959c-b994-4be2-9799-e6e33558c96f None None] Network 9705c593-9c13-4e4b-be01-144bdc52bae4 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:37:22.393428 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-4d62e957-2ab5-46ae-a092-bdfeb4def6ee tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/quotas/2441ab18acee4d4c9e276ba69a458348 HTTP/1.1" status: 200  len: 375 time: 0.0654688
May 25 16:37:22.395554 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:37:22.399992 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:22.407082 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:37:22.525287 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Pushing event updated for resources: {'Port': ['ID=bbc1c5c6-f690-4c0a-8371-dcdace27c48c,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:22.536453 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-5c56a70b-947d-4d72-a552-1e96ace4a40f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:22.563799 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50382) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:22.591121 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2082775398-network', 'tenant_id': '507935d4b65048e2827b6ea3ce8041af'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:22.605436 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:22.605609 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.381s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:22.609742 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-91b49bd2-0f8c-4a2e-a43e-8847801927aa tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=2441ab18acee4d4c9e276ba69a458348&fields=id HTTP/1.1" status: 200  len: 210 time: 0.2071934
May 25 16:37:22.614122 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-772c8354-afb2-4772-a575-9dd3296b038e service neutron] http://10.222.0.73:9696/v2.0/extensions returned with HTTP 200 {{(pid=92013) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 16:37:22.615118 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-772c8354-afb2-4772-a575-9dd3296b038e service neutron] 10.222.0.73 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.2862236
May 25 16:37:22.617061 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Usage tracker for resource:network and tenant:507935d4b65048e2827b6ea3ce8041af is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:22.623743 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:22.628661 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Pushing event updated for resources: {'Port': ['ID=ac87ab76-935f-4d0f-8362-43317047f063,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:22.634368 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.378s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:22.635272 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:22.859464 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-608cb4ef-589c-4c88-87f3-5f6d1633f7b6 service neutron] 10.222.0.73 "GET /v2.0/networks/48fa5bbf-9d42-4b66-8b53-a15b499d3d14?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2340744
May 25 16:37:22.907850 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Made reservation on behalf of 507935d4b65048e2827b6ea3ce8041af for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:22.911655 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:22.934404 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:22.943525 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-0dd5c8af-a1e9-4fea-a622-1a48615c5613 service neutron] http://10.222.0.73:9696/v2.0/extensions returned with HTTP 200 {{(pid=92013) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 16:37:22.944528 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-0dd5c8af-a1e9-4fea-a622-1a48615c5613 service neutron] 10.222.0.73 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1976650
May 25 16:37:22.960900 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Pushing event updated for resources: {'Port': ['ID=e21e5b5b-f759-4197-8593-9926a21b96d8,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:22.964688 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.429s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:22.972965 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:22.980962 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Usage tracker for resource:security_group_rule and tenant:507935d4b65048e2827b6ea3ce8041af is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:22.986070 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:22.988632 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:23.068478 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:23.324059 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-c1cbc7e2-3e13-47e3-b467-505f6322a950 service neutron] 10.222.0.73 "GET /v2.0/networks/48fa5bbf-9d42-4b66-8b53-a15b499d3d14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4638052
May 25 16:37:23.329192 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:23.399442 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-fdb0e776-631a-41c5-9262-644124a2ba09 service neutron] 10.222.0.73 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4454155
May 25 16:37:23.438324 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:23.449374 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:23.458447 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:23.493338 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 428}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:37:23.496068 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-506962', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-501218'] for router, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:23.602509 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a03e23e0-41cf-4f14-aa2f-e78425272ba5,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:23.614193 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:23.614537 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Added segment 76149067-3b0c-4a7a-b9d8-73abd1bd6ebd of type vlan for network 3c5c4067-0646-4b5c-856c-272b3622df48
May 25 16:37:23.624576 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:23.695518 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-83fb54cd-ea3c-4d64-bd69-3acf24bb15bd service neutron] 10.222.0.73 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2821238
May 25 16:37:23.818815 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:23.997097 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Router 103a2116-9bde-4af3-9e28-4c356cf4c6f7 is scheduled to L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 with binding_index 1 {{(pid=92012) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 16:37:24.006003 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:24.015493 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:24.016344 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:24.030106 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:24.193110 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c76801d7-c06a-4fee-8fd3-e8f7318baeb9 None None] Network ce683266-622a-4b13-a610-301441bf2882 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:37:24.299949 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-db3e6637-ad34-4de2-9ea2-f4af8379a420 req-10092830-6a4d-42a4-9f2f-611f5bc91046 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 210 time: 0.2947648
May 25 16:37:24.387557 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device e21e5b5b-f759-4197-8593-9926a21b96d8 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:37:24.401735 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-542585ec-3001-480e-88c0-c439652aab24 req-0dd6841d-90e7-42dd-aab0-01d63266a2b5 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 210 time: 0.1656806
May 25 16:37:24.457998 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-506962', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-501218'] for router, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:24.543653 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 1.9650810
May 25 16:37:24.546508 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Pushing event updated for resources: {'Network': ['ID=3c5c4067-0646-4b5c-856c-272b3622df48,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:24.549197 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50450) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:24.564153 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.534s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:24.568356 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Request body: {'subnet': {'network_id': '3c5c4067-0646-4b5c-856c-272b3622df48', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2082775398-subnet', 'tenant_id': '507935d4b65048e2827b6ea3ce8041af', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:24.576187 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:24.578843 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network 3c5c4067-0646-4b5c-856c-272b3622df48 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:37:24.579316 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:37:24.587835 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Usage tracker for resource:subnet and tenant:507935d4b65048e2827b6ea3ce8041af is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:24.594888 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Sync routers for ids ['103a2116-9bde-4af3-9e28-4c356cf4c6f7'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:37:24.609387 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Routers {'103a2116-9bde-4af3-9e28-4c356cf4c6f7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:37:24.614630 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:24.616287 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bb1f5b0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:37:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['103a2116-9bde-4af3-9e28-4c356cf4c6f7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:24.630528 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:24.664730 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Notify callbacks [] for router, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:24.674823 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] 10.222.0.73 "POST /v2.0/routers HTTP/1.1" status: 201  len: 929 time: 4.1948872
May 25 16:37:24.678335 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50464) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:24.830396 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-479c4077-cad3-414b-b92f-479eae79b493 None None] Provisioning for port e21e5b5b-f759-4197-8593-9926a21b96d8 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:37:24.922083 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Router d0ffdac8-c8d7-4bac-8f41-858898f1783d is scheduled to L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 with binding_index 1 {{(pid=92013) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 16:37:25.036355 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Made reservation on behalf of 507935d4b65048e2827b6ea3ce8041af for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:25.038709 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:25.137775 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port e21e5b5b-f759-4197-8593-9926a21b96d8 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:37:25.169007 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Set router 103a2116-9bde-4af3-9e28-4c356cf4c6f7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:37:25.179486 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port e21e5b5b-f759-4197-8593-9926a21b96d8 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:25.179486 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:25.188999 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:37:25.218020 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Notify callbacks [] for router, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:25.222775 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] 10.222.0.73 "POST /v2.0/routers HTTP/1.1" status: 201  len: 922 time: 6.0362196
May 25 16:37:25.224244 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 50490) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:25.396085 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Sync routers for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:37:25.475101 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dbce02d3-5b9e-4172-94b4-e6ecbdba92c3 req-4e8f5268-e0a8-46be-ab92-9fafa04f792d tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 210 time: 0.0707350
May 25 16:37:25.498515 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:37:25.499278 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bb55af0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:37:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:25.714700 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-434eedba-009d-4fe7-ac02-381947d0de07 req-e5044c2c-09f8-42cf-b7d3-5e85c10002c8 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 210 time: 0.1149528
May 25 16:37:25.849737 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bb1f5b0>, [{'id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'name': 'tempest-ServerRescueNegativeTestJSON-32259621-router', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:20Z', 'updated_at': '2021-05-25T16:37:22Z', 'revision_number': 3, 'project_id': 'fe57668427364ea7acb08a0f7f2826ed', 'gw_port': {'id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:36:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:25.859744 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Checking router: 103a2116-9bde-4af3-9e28-4c356cf4c6f7 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:37:25.860095 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Updating router 103a2116-9bde-4af3-9e28-4c356cf4c6f7 port ac87ab76-935f-4d0f-8362-43317047f063 binding host dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:37:25.986096 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:26.022234 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:37:26.067735 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:26.298598 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port e21e5b5b-f759-4197-8593-9926a21b96d8, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=e21e5b5b-f759-4197-8593-9926a21b96d8,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:37:26.322755 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:26.334475 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:26.450326 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:26.544021 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=e21e5b5b-f759-4197-8593-9926a21b96d8,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:26.548905 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:26.566860 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-077c412b-0a1d-4034-a855-32bd5816afa0 None None] Provisioning complete for port e21e5b5b-f759-4197-8593-9926a21b96d8 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:26.567478 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-077c412b-0a1d-4034-a855-32bd5816afa0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:26.572175 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Notify callbacks [] for port, precommit_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:26.597080 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.provisioning_blocks [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Transition to ACTIVE for port object ac87ab76-935f-4d0f-8362-43317047f063 will not be triggered until provisioned by entity L2. {{(pid=92015) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:37:26.614135 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:26.621632 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:26.662823 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bb55af0>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:22Z', 'revision_number': 3, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:26.702386 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Checking router: d0ffdac8-c8d7-4bac-8f41-858898f1783d for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:37:26.702386 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Updating router d0ffdac8-c8d7-4bac-8f41-858898f1783d port bbc1c5c6-f690-4c0a-8371-dcdace27c48c binding host dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:37:26.732852 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Attempting to bind port ac87ab76-935f-4d0f-8362-43317047f063 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:37:26.733498 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Attempting to bind port ac87ab76-935f-4d0f-8362-43317047f063 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:37:26.733998 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Attempting to bind port ac87ab76-935f-4d0f-8362-43317047f063 on network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:37:26.747680 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 37, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:37:26.748416 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Checking segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92015) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:26.749575 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:26.750130 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Bound using segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:37:26.750733 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Bound port: ac87ab76-935f-4d0f-8362-43317047f063, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:37:26.751212 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:26.791136 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:26.795799 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:26.818535 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a79a2bee-478c-4605-8726-f42ea7fffe14 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:26.821363 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:26.852758 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] For port ac87ab76-935f-4d0f-8362-43317047f063, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92015) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:37:26.856278 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-493b3c5a-bff3-475e-9805-30dab1ae1fff req-d7230164-f964-4589-971e-3b589cf75d48 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 210 time: 0.0671668
May 25 16:37:26.872849 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] For port ac87ab76-935f-4d0f-8362-43317047f063, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=ac87ab76-935f-4d0f-8362-43317047f063,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92015) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:37:26.902029 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:26.930394 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Pushing event updated for resources: {'Port': ['ID=ac87ab76-935f-4d0f-8362-43317047f063,revision_number=2']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:26.944148 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:26.945042 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:26.946642 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:26.947083 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:26.947472 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:26.947862 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:26.948245 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:26.948629 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:26.949036 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:26.949435 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:26.949840 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:26.950206 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Tracked resource versions report:
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]: pushed versions:
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]: {   'AddressGroup': {'1.2'},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     'ConntrackHelper': {'1.0'},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     'Log': {'1.0'},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     'Network': {'1.1'},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     'Port': {'1.7'},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     'PortForwarding': {'1.2'},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     'QosPolicy': {'1.8'},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     'SecurityGroup': {'1.4'},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     'SecurityGroupRule': {'1.2'},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     'SubPort': {'1.0'},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     'Subnet': {'1.1'},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     'Trunk': {'1.1'}}
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]: consumer versions:
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]: {   DHCP agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     HyperV agent@hv-cinder-78638: {},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     L3 agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     Metadata agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     Metering agent@dv-cinder-786386-6-iscsi: {},
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:     Open vSwitch agent@dv-cinder-786386-6-iscsi: {   'AddressGroup': '1.2',
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'ConntrackHelper': '1.0',
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'Log': '1.0',
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'Network': '1.1',
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'Port': '1.7',
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'PortForwarding': '1.2',
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'QosPolicy': '1.8',
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'SecurityGroup': '1.4',
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'SecurityGroupRule': '1.2',
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'SubPort': '1.0',
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'Subnet': '1.1',
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:                                                      'Trunk': '1.1'}}
May 25 16:37:26.951381 dv-cinder-786386-6-iscsi neutron-server[92015]:  {{(pid=92015) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 16:37:26.957671 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.336s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:26.958280 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-c9cdf701-c0bf-43d9-b0c8-3fcf850d188e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.046s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:27.003776 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Pushing event updated for resources: {'Subnet': ['ID=83866a75-4c6b-49d9-a66d-2f1c0cd05cb6,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:27.009524 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Routers {'103a2116-9bde-4af3-9e28-4c356cf4c6f7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:37:27.010321 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bb1f5b0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:37:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['103a2116-9bde-4af3-9e28-4c356cf4c6f7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:27.014886 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:27.032311 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Allocated IP 172.20.0.1 (1186d694-166f-4246-b68b-e7ce60cb0f02/5e6146eb-31ff-437b-a594-8ddb1d63042e/f766da42-735a-4b61-b332-9e92e16398ce) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:37:27.046307 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Checking segment: {'id': '76149067-3b0c-4a7a-b9d8-73abd1bd6ebd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 428, 'network_id': '3c5c4067-0646-4b5c-856c-272b3622df48'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:27.046683 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Network hostable DHCP agents. Network: 3c5c4067-0646-4b5c-856c-272b3622df48, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:37:27.087615 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e2fe5362-bf26-497a-bf18-40ffbabb33f7 req-ac88ae98-636c-437d-9aae-9c957f1a3359 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 210 time: 0.0531085
May 25 16:37:27.127838 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Pushing event updated for resources: {'Port': ['ID=ac87ab76-935f-4d0f-8362-43317047f063,revision_number=3']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:27.134091 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:27.176051 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Network 3c5c4067-0646-4b5c-856c-272b3622df48 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:37:27.203955 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Allocated IP 172.20.0.1 (ce683266-622a-4b13-a610-301441bf2882/06161ba6-62a3-443f-9cfb-bccf3f60ad9c/f4b0710d-b203-43ad-9bf9-b9df5851c043) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:37:27.214337 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, 3c5c4067-0646-4b5c-856c-272b3622df48) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:27.222383 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:27.222383 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:27.229733 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98233543-5ecb-4fb5-8dd5-2919a15fee67 None None] Network 3c5c4067-0646-4b5c-856c-272b3622df48 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:37:27.253694 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] Set router 103a2116-9bde-4af3-9e28-4c356cf4c6f7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:37:27.298174 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 2.7454860
May 25 16:37:27.317567 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:27.379084 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:27.385979 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:27.450171 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Network 1186d694-166f-4246-b68b-e7ce60cb0f02 is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:37:27.458076 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:27.460692 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:37:27.462793 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-501395'] for router_interface, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:27.476172 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:27.496541 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Transition to ACTIVE for port object f4b0710d-b203-43ad-9bf9-b9df5851c043 will not be triggered until provisioned by entity DHCP. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:37:27.537906 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:27.552364 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:27.553699 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Pushing event updated for resources: {'Port': ['ID=f766da42-735a-4b61-b332-9e92e16398ce,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:27.566349 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:27.616077 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Network ce683266-622a-4b13-a610-301441bf2882 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:37:27.624430 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:27.643460 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:37:27.643980 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-501395'] for router_interface, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:27.685110 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50544) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:27.702501 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7768d91e-1d79-4102-8800-91870045b5e0 None None] Network 3c5c4067-0646-4b5c-856c-272b3622df48 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:37:27.751113 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Notify callbacks [] for port, precommit_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:27.757491 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bb1f5b0>, [{'id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'name': 'tempest-ServerRescueNegativeTestJSON-32259621-router', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:20Z', 'updated_at': '2021-05-25T16:37:22Z', 'revision_number': 3, 'project_id': 'fe57668427364ea7acb08a0f7f2826ed', 'gw_port': {'id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:36:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:27.765929 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-016c23b0-2fa4-4db9-9c4e-ab126dd03cc5 None None] The sync data for ids ['103a2116-9bde-4af3-9e28-4c356cf4c6f7'] in dv-cinder-786386-6-iscsi is: [{'id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'name': 'tempest-ServerRescueNegativeTestJSON-32259621-router', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:20Z', 'updated_at': '2021-05-25T16:37:22Z', 'revision_number': 3, 'project_id': 'fe57668427364ea7acb08a0f7f2826ed', 'gw_port': {'id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:36:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:37:27.875932 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Pushing event updated for resources: {'Port': ['ID=f4b0710d-b203-43ad-9bf9-b9df5851c043,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:27.877066 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_v2 [None req-f594c2ee-b674-49d6-aaf5-eaea6c09c8f0 admin admin] Deleting subnet 6b42c049-ad04-4881-b6e0-fa9912cd6889 {{(pid=92012) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:37:27.880154 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:27.909286 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Transition to ACTIVE for port object bbc1c5c6-f690-4c0a-8371-dcdace27c48c will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:37:27.909504 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f594c2ee-b674-49d6-aaf5-eaea6c09c8f0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:27.945158 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:27.977677 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:27.985684 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.079658 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f594c2ee-b674-49d6-aaf5-eaea6c09c8f0 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.096587 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f594c2ee-b674-49d6-aaf5-eaea6c09c8f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.098136 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-be76f056-ac5d-48a8-aaeb-9c6a17fa1299 req-223c36d2-c766-4a47-b8d8-5ac889a843f7 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 210 time: 0.0552835
May 25 16:37:28.158806 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.224765 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-7cbb6ace-629b-40d3-80e7-5c7cb96c4a54 None None] Provisioning for port f4b0710d-b203-43ad-9bf9-b9df5851c043 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:37:28.230981 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Attempting to bind port bbc1c5c6-f690-4c0a-8371-dcdace27c48c on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:37:28.231162 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Attempting to bind port bbc1c5c6-f690-4c0a-8371-dcdace27c48c by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:37:28.231443 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Attempting to bind port bbc1c5c6-f690-4c0a-8371-dcdace27c48c on network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:37:28.297586 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fbc1e9c-88d2-4dee-bb57-325b8b56a42c None None] Pushing event updated for resources: {'Port': ['ID=bbc1c5c6-f690-4c0a-8371-dcdace27c48c,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:28.303415 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-4fbc1e9c-88d2-4dee-bb57-325b8b56a42c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.326s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:28.304998 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 37, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:37:28.305884 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Checking segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:28.306556 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.307271 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Bound using segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:37:28.308548 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Bound port: bbc1c5c6-f690-4c0a-8371-dcdace27c48c, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:37:28.308548 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.334111 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-7cbb6ace-629b-40d3-80e7-5c7cb96c4a54 None None] Provisioning complete for port f4b0710d-b203-43ad-9bf9-b9df5851c043 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:28.334635 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7cbb6ace-629b-40d3-80e7-5c7cb96c4a54 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.376400 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.404576 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-af4962e6-b346-474f-a4a7-0b4466fd6178 req-f91a1b53-2234-4d00-8df4-5ef6eaf575cc tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 210 time: 0.1244903
May 25 16:37:28.428063 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-7cbb6ace-629b-40d3-80e7-5c7cb96c4a54 None None] Port f4b0710d-b203-43ad-9bf9-b9df5851c043 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:37:28.497157 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.498411 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630485', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-501310'] for router_interface, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.500406 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] For port bbc1c5c6-f690-4c0a-8371-dcdace27c48c, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:37:28.504088 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] For port bbc1c5c6-f690-4c0a-8371-dcdace27c48c, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=bbc1c5c6-f690-4c0a-8371-dcdace27c48c,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:37:28.505633 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:28.513201 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.518122 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-4fbc1e9c-88d2-4dee-bb57-325b8b56a42c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:28.560136 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device e21e5b5b-f759-4197-8593-9926a21b96d8 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:37:28.631376 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.641547 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.642740 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630485', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-501310'] for router_interface, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:28.646554 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-40b57520-8d9f-4119-8ee8-85016500baa2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:28.686420 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:37:28.687221 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bb55af0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:37:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:28.743024 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Pushing event updated for resources: {'Port': ['ID=f766da42-735a-4b61-b332-9e92e16398ce,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:28.757477 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fbc1e9c-88d2-4dee-bb57-325b8b56a42c None None] Pushing event updated for resources: {'Port': ['ID=bbc1c5c6-f690-4c0a-8371-dcdace27c48c,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:28.759054 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:28.772215 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-4fbc1e9c-88d2-4dee-bb57-325b8b56a42c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.254s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:28.806256 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Pushing event updated for resources: {'Port': ['ID=f4b0710d-b203-43ad-9bf9-b9df5851c043,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:28.810674 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:28.892879 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Network ce683266-622a-4b13-a610-301441bf2882 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:37:28.896603 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:28.904831 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Network 1186d694-166f-4246-b68b-e7ce60cb0f02 is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:37:28.907433 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:28.969855 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port e21e5b5b-f759-4197-8593-9926a21b96d8 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:28.970870 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:29.097429 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f594c2ee-b674-49d6-aaf5-eaea6c09c8f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852'] for subnet, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:29.117898 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:37:29.118942 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:29.257707 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f594c2ee-b674-49d6-aaf5-eaea6c09c8f0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:29.273609 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f594c2ee-b674-49d6-aaf5-eaea6c09c8f0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6b42c049-ad04-4881-b6e0-fa9912cd6889,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:29.286786 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f594c2ee-b674-49d6-aaf5-eaea6c09c8f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:29.291554 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f594c2ee-b674-49d6-aaf5-eaea6c09c8f0 admin admin] 10.222.0.73 "DELETE /v2.0/subnets/6b42c049-ad04-4881-b6e0-fa9912cd6889 HTTP/1.1" status: 204  len: 168 time: 1.5999603
May 25 16:37:29.293490 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50568) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:29.341377 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f0164fed-3a5f-4eda-add1-9bed5ee37b15 req-3eefca63-ec9f-45a8-ba7b-f617182d31bc tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 210 time: 0.0713563
May 25 16:37:29.378939 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Router d0ffdac8-c8d7-4bac-8f41-858898f1783d has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:37:29.433579 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Router 103a2116-9bde-4af3-9e28-4c356cf4c6f7 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:37:29.440890 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:29.635251 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.76', 57583) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:29.686056 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-5ac73c7d-0ab0-4908-a0a4-f2c817d6236a None None] Provisioning complete for port f4b0710d-b203-43ad-9bf9-b9df5851c043 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:29.686596 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-5ac73c7d-0ab0-4908-a0a4-f2c817d6236a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:29.719236 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device ac87ab76-935f-4d0f-8362-43317047f063 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:37:29.849303 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-986ec8b5-0993-4f94-91a4-6b1bb1d95171 req-77491925-b93b-4019-8d63-f23b0157879e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 210 time: 0.2153640
May 25 16:37:29.850431 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-5ac73c7d-0ab0-4908-a0a4-f2c817d6236a None None] Port f4b0710d-b203-43ad-9bf9-b9df5851c043 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:37:29.918987 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:37:29.922681 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port ac87ab76-935f-4d0f-8362-43317047f063 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:37:29.938872 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port ac87ab76-935f-4d0f-8362-43317047f063 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:29.938872 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:29.958673 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] 10.222.0.73 "PUT /v2.0/routers/d0ffdac8-c8d7-4bac-8f41-858898f1783d/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.7240663
May 25 16:37:30.034073 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-2c4af6b7-d57e-4325-a1da-49784c58b1a3 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:30.035877 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-2c4af6b7-d57e-4325-a1da-49784c58b1a3 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.76 "GET /v2.0/networks?id=48fa5bbf-9d42-4b66-8b53-a15b499d3d14 HTTP/1.1" status: 200  len: 811 time: 0.4003506
May 25 16:37:30.040984 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bb55af0>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 2, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:30.074610 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:37:30.077546 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:30.078631 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-706f8a96-5cec-426a-a5a4-743d43132933 None None] The sync data for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi is: [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 2, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:37:30.088206 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] 10.222.0.73 "PUT /v2.0/routers/103a2116-9bde-4af3-9e28-4c356cf4c6f7/add_router_interface HTTP/1.1" status: 200  len: 503 time: 5.4083729
May 25 16:37:30.109349 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Request body: {'port': {'device_id': '202b7b00-4b4f-4282-b5ca-6e5f51a3a967', 'network_id': '48fa5bbf-9d42-4b66-8b53-a15b499d3d14', 'admin_state_up': True, 'tenant_id': '5d60da5ade5b4981948179f148ef1f56'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:30.112969 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7f346c31b910>> segment before_delete 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.119274 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7f346c31b910>> subnet precommit_delete_associations 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.120811 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346b82dc40>> segment_host_mapping after_create 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.121328 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346b82dc40>> port after_create 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.121854 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346b82dc40>> port after_delete 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.122358 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346b82dc40>> port after_update 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.122842 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346b82dc40>> segment after_delete 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.123327 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346b82dc40>> subnet after_create 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.123801 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346b82dc40>> subnet after_delete 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.124276 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346b82dc40>> subnet after_update 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.236868 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Sync routers for ids ['103a2116-9bde-4af3-9e28-4c356cf4c6f7'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:37:30.311026 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Routers {'103a2116-9bde-4af3-9e28-4c356cf4c6f7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:37:30.315780 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bb1f3a0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:37:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['103a2116-9bde-4af3-9e28-4c356cf4c6f7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:30.480658 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:30.541848 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:30.568608 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port ac87ab76-935f-4d0f-8362-43317047f063, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=ac87ab76-935f-4d0f-8362-43317047f063,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:37:30.578793 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Usage tracker for resource:port and tenant:5d60da5ade5b4981948179f148ef1f56 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:30.583436 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:30.588302 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:30.593350 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-4fbc1e9c-88d2-4dee-bb57-325b8b56a42c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:30.608718 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f346c5d78e0>> subnet after_create 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.609096 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f346c5d78e0>> subnet after_delete 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.609438 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f346c5d78e0>> subnet before_create 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.613766 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:30.631100 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f346c5d78e0>> subnet before_update 55550000 {{(pid=92012) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:37:30.632773 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346b82dca0>,) {'filters': {'network_id': ['9705c593-9c13-4e4b-be01-144bdc52bae4']}} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:30.675408 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Made reservation on behalf of 5d60da5ade5b4981948179f148ef1f56 for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:30.679585 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:30.699325 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b82dca0>, 'b7ca3982-a156-48a4-94a1-419aff666ce0') {'for_net_delete': True} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:30.699656 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b82dca0>, 'b7ca3982-a156-48a4-94a1-419aff666ce0') {} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:30.726999 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.76', 57590) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:30.746340 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-976068'] for segment, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:30.852306 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=ac87ab76-935f-4d0f-8362-43317047f063,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:30.861973 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.269s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:31.020198 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-53afe7df-9553-4f79-aa23-2b0d22427685 req-078ead4e-6b19-49a0-af25-f54c3caff6a7 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 210 time: 0.1238186
May 25 16:37:31.057353 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:31.081089 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Releasing vlan 421 on physical network physnet1 to pool {{(pid=92012) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:37:31.092035 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7823239'] for segment, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   from cryptography.utils import int_from_bytes
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   from cryptography.utils import int_from_bytes
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]: Traceback (most recent call last):
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     timer()
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     cb(*args, **kw)
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     return func(*args, **kwargs)
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     self._notify()
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     self.callback(batched_events)
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     event.method(event)
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     return f(self, *a, **k)
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._get(url).json()
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self.request(url, 'GET', **kwargs)
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:37:31.143651 dv-cinder-786386-6-iscsi neutron-server[92012]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:37:31.197087 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Set router 103a2116-9bde-4af3-9e28-4c356cf4c6f7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:37:31.343762 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50656) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:31.393876 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-25d5e045-6df2-4f41-941a-e4fb9237a13c req-59037a0e-a71d-4374-ba1b-2fffe8c6a21f tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 210 time: 0.1087427
May 25 16:37:31.421090 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Allocated IP 172.20.0.11 (48fa5bbf-9d42-4b66-8b53-a15b499d3d14/b953f31d-4490-4000-b4a7-9a7cdcd546da/d6963172-fb53-4ee4-95ea-1609b9d40db4) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:37:31.423839 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-819d29a6-d065-491a-bbdf-0b818853054c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:31.506574 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-2031ec76-10bc-4977-b43d-07c1a7be4001 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:31.510479 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-2031ec76-10bc-4977-b43d-07c1a7be4001 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Synchronizing usage tracker for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:network {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:37:31.525719 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:31.551310 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:31.580895 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50672) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:31.582649 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:31.625950 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1455889409', 'description': 'tempest-description--2066732040'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:31.658449 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:31.677389 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] 10.222.0.73 "DELETE /v2.0/networks/9705c593-9c13-4e4b-be01-144bdc52bae4 HTTP/1.1" status: 204  len: 168 time: 2.3803527
May 25 16:37:31.679409 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Pushing event deleted for resources: {'Network': ['ID=9705c593-9c13-4e4b-be01-144bdc52bae4,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:31.682685 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:31.685907 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Usage tracker for resource:security_group and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:31.689180 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50680) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:31.692280 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:31.760999 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-2031ec76-10bc-4977-b43d-07c1a7be4001 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Unset dirty status for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:network {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:37:31.762234 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-2031ec76-10bc-4977-b43d-07c1a7be4001 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "GET /v2.0/networks?id=e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 200  len: 814 time: 1.0342906
May 25 16:37:31.764852 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:31.778168 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e90833ec-8884-431b-8c5c-56c0f3fa4d4f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:31.805874 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Request body: {'port': {'device_id': 'a7788ff0-f301-463e-8b35-fead9db52a0c', 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42', 'admin_state_up': True, 'tenant_id': '2441ab18acee4d4c9e276ba69a458348'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:31.836621 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-e90833ec-8884-431b-8c5c-56c0f3fa4d4f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:31.841771 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:31.991746 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-e90833ec-8884-431b-8c5c-56c0f3fa4d4f admin admin] Usage tracker for resource:security_group_rule and tenant:3077379ce9ac4b9ba39f6332b952eb42 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:32.006959 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bb1f3a0>, [{'id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'name': 'tempest-ServerRescueNegativeTestJSON-32259621-router', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:20Z', 'updated_at': '2021-05-25T16:37:27Z', 'revision_number': 4, 'project_id': 'fe57668427364ea7acb08a0f7f2826ed', 'gw_port': {'id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:36:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f766da42-735a-4b61-b332-9e92e16398ce', 'name': '', 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'mac_address': 'fa:16:3e:ba:2e:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '5e6146eb-31ff-437b-a594-8ddb1d63042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 2, 'project_id': 'fe57668427364ea7acb08a0f7f2826ed', 'subnets': [{'id': '5e6146eb-31ff-437b-a594-8ddb1d63042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:32.024538 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Checking router: 103a2116-9bde-4af3-9e28-4c356cf4c6f7 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:37:32.024936 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Updating router 103a2116-9bde-4af3-9e28-4c356cf4c6f7 port f766da42-735a-4b61-b332-9e92e16398ce binding host dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:37:32.064393 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_v2 [None req-ae794e5a-f80f-4115-ad78-bfe1c276f1a9 admin admin] Deleting subnet 83866a75-4c6b-49d9-a66d-2f1c0cd05cb6 {{(pid=92012) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:37:32.091118 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-e90833ec-8884-431b-8c5c-56c0f3fa4d4f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:32.167182 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:32.172863 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-e90833ec-8884-431b-8c5c-56c0f3fa4d4f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:32.181600 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ae794e5a-f80f-4115-ad78-bfe1c276f1a9 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:32.292363 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:32.294931 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:32.303023 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:32.314441 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Usage tracker for resource:security_group_rule and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:32.322877 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:32.327389 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:32.343482 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:32.514790 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:32.701884 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50714) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:32.735322 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:32.892555 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:32.951817 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device bbc1c5c6-f690-4c0a-8371-dcdace27c48c up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:37:32.966309 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:32.973352 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 1.3631074
May 25 16:37:32.976725 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50722) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:33.087163 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-5293a9db-69ea-44b2-8e11-d7d16ecd1b63 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Request body: {'security_group_rule': {'security_group_id': 'b257116c-be87-401f-9cd7-142eb1c0353f', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:33.104653 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port bbc1c5c6-f690-4c0a-8371-dcdace27c48c completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:37:33.118499 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port bbc1c5c6-f690-4c0a-8371-dcdace27c48c triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:33.119364 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.119482 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ae794e5a-f80f-4115-ad78-bfe1c276f1a9 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-976079'] for subnet, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.150793 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Pushing event updated for resources: {'Port': ['ID=d6963172-fb53-4ee4-95ea-1609b9d40db4,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:33.160803 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Network 48fa5bbf-9d42-4b66-8b53-a15b499d3d14 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:37:33.164677 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:33.181204 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.854s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:33.232930 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:37:33.240785 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:33.241689 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.251163 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-5293a9db-69ea-44b2-8e11-d7d16ecd1b63 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:33.263631 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-5293a9db-69ea-44b2-8e11-d7d16ecd1b63 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Usage tracker for resource:security_group_rule and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:33.278157 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 3.1734085
May 25 16:37:33.288834 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-5293a9db-69ea-44b2-8e11-d7d16ecd1b63 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:33.303288 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db42263-5b2b-4edd-9d82-5ad0851b4f40 req-0068872d-1cd3-4dc9-92ad-5e04afdb1739 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:33.305639 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-1db42263-5b2b-4edd-9d82-5ad0851b4f40 req-0068872d-1cd3-4dc9-92ad-5e04afdb1739 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Synchronizing usage tracker for tenant:5d60da5ade5b4981948179f148ef1f56 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:37:33.308273 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-5293a9db-69ea-44b2-8e11-d7d16ecd1b63 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:33.370712 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-10feb411-2e7c-4268-ba9b-b9b07cc4baca tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:33.379206 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-10feb411-2e7c-4268-ba9b-b9b07cc4baca tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/networks?id=1186d694-166f-4246-b68b-e7ce60cb0f02 HTTP/1.1" status: 200  len: 817 time: 0.9497333
May 25 16:37:33.397911 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Notify callbacks [] for port, precommit_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.398859 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-baeabc66-08ad-4fc8-bd5e-557738eec0fe tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/quotas/fe57668427364ea7acb08a0f7f2826ed HTTP/1.1" status: 200  len: 375 time: 0.0182698
May 25 16:37:33.421277 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.provisioning_blocks [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Transition to ACTIVE for port object f766da42-735a-4b61-b332-9e92e16398ce will not be triggered until provisioned by entity L2. {{(pid=92015) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:37:33.437806 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.456365 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:33.469526 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.485574 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e90833ec-8884-431b-8c5c-56c0f3fa4d4f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.495021 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:33.500151 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Usage tracker for resource:port and tenant:2441ab18acee4d4c9e276ba69a458348 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:33.504121 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0d541ec2-45ae-40de-95d1-ff9e083916c8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.519016 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:33.522653 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port bbc1c5c6-f690-4c0a-8371-dcdace27c48c, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=bbc1c5c6-f690-4c0a-8371-dcdace27c48c,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:37:33.539999 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.541954 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device ac87ab76-935f-4d0f-8362-43317047f063 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:37:33.570005 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-1db42263-5b2b-4edd-9d82-5ad0851b4f40 req-0068872d-1cd3-4dc9-92ad-5e04afdb1739 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Unset dirty status for tenant:5d60da5ade5b4981948179f148ef1f56 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:37:33.572878 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ae794e5a-f80f-4115-ad78-bfe1c276f1a9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.575682 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1db42263-5b2b-4edd-9d82-5ad0851b4f40 req-0068872d-1cd3-4dc9-92ad-5e04afdb1739 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 932 time: 1.0972593
May 25 16:37:33.600467 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:33.731741 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-0d541ec2-45ae-40de-95d1-ff9e083916c8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:33.737063 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-0d541ec2-45ae-40de-95d1-ff9e083916c8 admin admin] Usage tracker for resource:security_group_rule and tenant:046f0a95f1ba4508be93955a9b3de007 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:33.741923 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-0d541ec2-45ae-40de-95d1-ff9e083916c8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:33.751930 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-0d541ec2-45ae-40de-95d1-ff9e083916c8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:33.800139 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1db42263-5b2b-4edd-9d82-5ad0851b4f40 req-3e14e58e-432a-4445-b8e7-d19bc34085c2 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2080698
May 25 16:37:33.829453 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-c24cf0b1-cb2a-40d3-b753-a4d13dd64e10 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=fe57668427364ea7acb08a0f7f2826ed&fields=id HTTP/1.1" status: 200  len: 255 time: 0.4293642
May 25 16:37:33.898230 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3cc46f6-fae3-4772-891a-9fa4b2a9e8cd None None] Pushing event updated for resources: {'Port': ['ID=f766da42-735a-4b61-b332-9e92e16398ce,revision_number=3']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:33.939070 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0d541ec2-45ae-40de-95d1-ff9e083916c8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.942111 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=bbc1c5c6-f690-4c0a-8371-dcdace27c48c,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:33.942867 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e90833ec-8884-431b-8c5c-56c0f3fa4d4f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.951077 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.958913 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.358s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:33.970093 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port ac87ab76-935f-4d0f-8362-43317047f063 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:33.970515 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:33.985549 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-c3cc46f6-fae3-4772-891a-9fa4b2a9e8cd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.529s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:34.141228 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Attempting to bind port f766da42-735a-4b61-b332-9e92e16398ce on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:37:34.142327 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Attempting to bind port f766da42-735a-4b61-b332-9e92e16398ce by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '227f55be-6fbd-4206-b845-6ee4d0737571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02'}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:37:34.143053 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Attempting to bind port f766da42-735a-4b61-b332-9e92e16398ce on network 1186d694-166f-4246-b68b-e7ce60cb0f02 {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:37:34.154556 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 37, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:37:34.155346 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Checking segment: {'id': '227f55be-6fbd-4206-b845-6ee4d0737571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92015) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:34.155961 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:34.156150 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-696c5056-216b-46b2-b92c-4a06d0e37000 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:34.156764 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Bound using segment: {'id': '227f55be-6fbd-4206-b845-6ee4d0737571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02'} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:37:34.157575 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Bound port: f766da42-735a-4b61-b332-9e92e16398ce, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '227f55be-6fbd-4206-b845-6ee4d0737571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02'}}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:37:34.158168 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:34.225324 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b257116c-be87-401f-9cd7-142eb1c0353f,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:34.228526 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5293a9db-69ea-44b2-8e11-d7d16ecd1b63 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:34.254307 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:34.257277 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.366s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:34.292705 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] For port f766da42-735a-4b61-b332-9e92e16398ce, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92015) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:37:34.296803 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ae794e5a-f80f-4115-ad78-bfe1c276f1a9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7721505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-697619'] for subnet, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:34.297734 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0d541ec2-45ae-40de-95d1-ff9e083916c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:34.298311 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] For port f766da42-735a-4b61-b332-9e92e16398ce, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=f766da42-735a-4b61-b332-9e92e16398ce,segment=NetworkSegment(227f55be-6fbd-4206-b845-6ee4d0737571),segment_id=227f55be-6fbd-4206-b845-6ee4d0737571)] {{(pid=92015) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:37:34.302968 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-4652b2ec-6fcb-491c-b0d7-bc34cbf27320 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:34.306932 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:34.313444 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-e90833ec-8884-431b-8c5c-56c0f3fa4d4f admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=3077379ce9ac4b9ba39f6332b952eb42&name=default HTTP/1.1" status: 200  len: 2975 time: 2.9546647
May 25 16:37:34.319646 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Sync routers for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:37:34.322692 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:34.340597 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-aa31c10d-75a0-4a73-80b7-a5a6d690dfcc req-fc5d9b65-9763-4839-b94b-9fd9cc8be5f1 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 210 time: 0.1612685
May 25 16:37:34.358502 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 50730) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:34.369060 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:37:34.370315 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b79b250>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:37:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:34.372073 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-c8c6fddc-b731-4029-97e9-04e6519c0dc2 service neutron] 10.222.0.73 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5225604
May 25 16:37:34.381900 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-0d541ec2-45ae-40de-95d1-ff9e083916c8 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=046f0a95f1ba4508be93955a9b3de007&name=default HTTP/1.1" status: 200  len: 2975 time: 1.6762736
May 25 16:37:34.383737 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ae794e5a-f80f-4115-ad78-bfe1c276f1a9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:34.396851 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50732) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:34.403538 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-ae794e5a-f80f-4115-ad78-bfe1c276f1a9 admin admin] 10.222.0.73 "DELETE /v2.0/subnets/83866a75-4c6b-49d9-a66d-2f1c0cd05cb6 HTTP/1.1" status: 204  len: 168 time: 2.7129846
May 25 16:37:34.426316 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50738) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:34.510579 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Routers {'103a2116-9bde-4af3-9e28-4c356cf4c6f7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:37:34.511347 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bb1f3a0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:37:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['103a2116-9bde-4af3-9e28-4c356cf4c6f7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:34.613722 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3cc46f6-fae3-4772-891a-9fa4b2a9e8cd None None] Pushing event updated for resources: {'Port': ['ID=f766da42-735a-4b61-b332-9e92e16398ce,revision_number=4']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:34.625586 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:34.626458 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-c3cc46f6-fae3-4772-891a-9fa4b2a9e8cd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.304s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:34.629492 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Made reservation on behalf of 2441ab18acee4d4c9e276ba69a458348 for: {'port': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:34.633651 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:34.655225 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0c010958-b7ab-483f-a517-6175ecb0614b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:34.664781 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1118cafe-2ecc-4d42-ab99-4ba717f2bd39 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:34.720664 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1118cafe-2ecc-4d42-ab99-4ba717f2bd39 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:34.823320 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device bbc1c5c6-f690-4c0a-8371-dcdace27c48c up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:37:34.919792 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Allocated IP 172.20.0.5 (e55be10d-206c-4bb4-8273-c9b859b11a42/c4c2aef1-f957-410f-9038-a1d13568aa6e/39034fee-da76-49d9-a359-2be89ce60575) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:37:34.982688 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1118cafe-2ecc-4d42-ab99-4ba717f2bd39 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:35.007259 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e90833ec-8884-431b-8c5c-56c0f3fa4d4f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e3fc4b53-5e4c-4f6a-b9de-db6731acf6dc,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:35.074696 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] Set router 103a2116-9bde-4af3-9e28-4c356cf4c6f7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:37:35.123990 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:35.158152 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:35.166344 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1118cafe-2ecc-4d42-ab99-4ba717f2bd39 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3fc4b53-5e4c-4f6a-b9de-db6731acf6dc,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:35.207744 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port bbc1c5c6-f690-4c0a-8371-dcdace27c48c triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:35.208551 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:35.224459 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-1be9854f-438e-421e-88e9-84e20e4c00e3 service neutron] 10.222.0.73 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.8502378
May 25 16:37:35.239485 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-1118cafe-2ecc-4d42-ab99-4ba717f2bd39 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:35.255726 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:37:35.270492 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1118cafe-2ecc-4d42-ab99-4ba717f2bd39 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:35.272551 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-1118cafe-2ecc-4d42-ab99-4ba717f2bd39 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/e3fc4b53-5e4c-4f6a-b9de-db6731acf6dc HTTP/1.1" status: 204  len: 168 time: 0.8961847
May 25 16:37:35.323686 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ada17075-1d30-473c-a2c4-12a677ca58ba req-b9b0d91a-b162-42fa-aaff-8515cdb79e03 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:35.334463 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ada17075-1d30-473c-a2c4-12a677ca58ba req-b9b0d91a-b162-42fa-aaff-8515cdb79e03 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 932 time: 0.3033466
May 25 16:37:35.435961 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:35.473353 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ada17075-1d30-473c-a2c4-12a677ca58ba req-eac31ab4-bcba-45a1-942a-d633e1abab4f tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1226473
May 25 16:37:35.772324 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-40c129c7-1077-4555-89e4-1a326bf6d169 req-4192a431-058d-46f5-90ca-9af3d85562e5 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 210 time: 0.1432543
May 25 16:37:35.859951 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5293a9db-69ea-44b2-8e11-d7d16ecd1b63 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:35.887026 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346b505a00>,) {'filters': {'network_id': ['3c5c4067-0646-4b5c-856c-272b3622df48']}} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:35.927787 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5293a9db-69ea-44b2-8e11-d7d16ecd1b63 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:35.949033 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bb1f3a0>, [{'id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'name': 'tempest-ServerRescueNegativeTestJSON-32259621-router', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:20Z', 'updated_at': '2021-05-25T16:37:27Z', 'revision_number': 4, 'project_id': 'fe57668427364ea7acb08a0f7f2826ed', 'gw_port': {'id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:36:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f766da42-735a-4b61-b332-9e92e16398ce', 'name': '', 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'mac_address': 'fa:16:3e:ba:2e:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '5e6146eb-31ff-437b-a594-8ddb1d63042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:34Z', 'revision_number': 4, 'project_id': 'fe57668427364ea7acb08a0f7f2826ed', 'subnets': [{'id': '5e6146eb-31ff-437b-a594-8ddb1d63042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:35.968928 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab7c72f0-9404-4e72-90ab-41ec8f89f912 None None] The sync data for ids ['103a2116-9bde-4af3-9e28-4c356cf4c6f7'] in dv-cinder-786386-6-iscsi is: [{'id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'name': 'tempest-ServerRescueNegativeTestJSON-32259621-router', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:20Z', 'updated_at': '2021-05-25T16:37:27Z', 'revision_number': 4, 'project_id': 'fe57668427364ea7acb08a0f7f2826ed', 'gw_port': {'id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:36:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f766da42-735a-4b61-b332-9e92e16398ce', 'name': '', 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'mac_address': 'fa:16:3e:ba:2e:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': '5e6146eb-31ff-437b-a594-8ddb1d63042e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:34Z', 'revision_number': 4, 'project_id': 'fe57668427364ea7acb08a0f7f2826ed', 'subnets': [{'id': '5e6146eb-31ff-437b-a594-8ddb1d63042e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:37:35.978273 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dec9c0fe-b5ea-4b34-8b21-62f9856e7ff9 req-459362f1-c4db-4bf3-82e0-5b50d504439b tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 210 time: 0.1811359
May 25 16:37:36.002137 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b505a00>, '76149067-3b0c-4a7a-b9d8-73abd1bd6ebd') {'for_net_delete': True} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:36.008883 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b505a00>, '76149067-3b0c-4a7a-b9d8-73abd1bd6ebd') {} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:36.026569 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0c010958-b7ab-483f-a517-6175ecb0614b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:36.114017 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-976068'] for segment, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:36.150655 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:36.166426 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] Releasing vlan 428 on physical network physnet1 to pool {{(pid=92012) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:37:36.166933 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7823239'] for segment, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:36.215122 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b79b250>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 2, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:36.224826 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Checking router: d0ffdac8-c8d7-4bac-8f41-858898f1783d for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:37:36.225185 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Updating router d0ffdac8-c8d7-4bac-8f41-858898f1783d port f4b0710d-b203-43ad-9bf9-b9df5851c043 binding host dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:37:36.323676 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:36.350190 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d541ec2-45ae-40de-95d1-ff9e083916c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f6ec9b6-4da2-4b11-8c32-3b5a8e55d9b4,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]: Traceback (most recent call last):
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     timer()
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     cb(*args, **kw)
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     return func(*args, **kwargs)
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     self._notify()
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     self.callback(batched_events)
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     event.method(event)
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     return f(self, *a, **k)
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._get(url).json()
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self.request(url, 'GET', **kwargs)
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:37:36.363503 dv-cinder-786386-6-iscsi neutron-server[92012]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:37:36.366321 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0d541ec2-45ae-40de-95d1-ff9e083916c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 2.062s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:36.406097 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3d026e64-89bb-4131-9650-0c1e4fa4c2b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 2.031s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:36.480499 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae794e5a-f80f-4115-ad78-bfe1c276f1a9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=83866a75-4c6b-49d9-a66d-2f1c0cd05cb6,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:36.498413 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ae794e5a-f80f-4115-ad78-bfe1c276f1a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:36.499222 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 2.122s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:36.499522 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:36.508172 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.435s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:36.590171 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:36.643080 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5293a9db-69ea-44b2-8e11-d7d16ecd1b63 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5696eeae-8536-41b7-b0f3-4d503bcf6241,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:36.655201 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5293a9db-69ea-44b2-8e11-d7d16ecd1b63 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:36.656661 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-5293a9db-69ea-44b2-8e11-d7d16ecd1b63 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 3.6387904
May 25 16:37:36.657586 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:36.666000 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 50786) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:36.707583 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-5293a9db-69ea-44b2-8e11-d7d16ecd1b63 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:36.721877 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-8644550f-9ea2-4e6b-8886-500de06a0284 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Request body: {'security_group_rule': {'security_group_id': 'b257116c-be87-401f-9cd7-142eb1c0353f', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:36.739835 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-8644550f-9ea2-4e6b-8886-500de06a0284 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:36.741677 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:36.746897 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-8644550f-9ea2-4e6b-8886-500de06a0284 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Usage tracker for resource:security_group_rule and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:36.755475 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-8644550f-9ea2-4e6b-8886-500de06a0284 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:36.762462 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0c010958-b7ab-483f-a517-6175ecb0614b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:36.775584 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f4564684-208c-4e32-b6e5-a3f614aa5e9f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:36.812511 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-8644550f-9ea2-4e6b-8886-500de06a0284 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:36.821667 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:36.829301 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-443c1bd6-7d59-4e55-a8ff-e940e970b8f0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:36.834481 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-443c1bd6-7d59-4e55-a8ff-e940e970b8f0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/networks?id=1186d694-166f-4246-b68b-e7ce60cb0f02 HTTP/1.1" status: 200  len: 817 time: 0.5066595
May 25 16:37:36.859098 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a51579e6-f6af-488c-a6a1-5945f6bfedf1 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/quotas/fe57668427364ea7acb08a0f7f2826ed HTTP/1.1" status: 200  len: 375 time: 0.0236816
May 25 16:37:36.872029 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] Pushing event deleted for resources: {'Network': ['ID=3c5c4067-0646-4b5c-856c-272b3622df48,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:36.904839 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0c010958-b7ab-483f-a517-6175ecb0614b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:36.907040 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-0c010958-b7ab-483f-a517-6175ecb0614b admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/6f6ec9b6-4da2-4b11-8c32-3b5a8e55d9b4 HTTP/1.1" status: 204  len: 168 time: 2.5024111
May 25 16:37:36.914533 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:36.915050 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0d541ec2-45ae-40de-95d1-ff9e083916c8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.067s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:36.941052 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c010958-b7ab-483f-a517-6175ecb0614b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f6ec9b6-4da2-4b11-8c32-3b5a8e55d9b4,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:36.949738 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0c010958-b7ab-483f-a517-6175ecb0614b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:36.953527 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device f766da42-735a-4b61-b332-9e92e16398ce up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:37:36.993905 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c77904b6-cbb1-4569-911e-03cf8cf6f458 admin admin] 10.222.0.73 "DELETE /v2.0/networks/3c5c4067-0646-4b5c-856c-272b3622df48 HTTP/1.1" status: 204  len: 168 time: 2.5257180
May 25 16:37:37.041689 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:37.055463 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8644550f-9ea2-4e6b-8886-500de06a0284 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:37.057821 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-de6186ac-8868-4791-882e-b5f7f56d6ce1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:37.159125 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8644550f-9ea2-4e6b-8886-500de06a0284 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:37.198935 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-2c0727be-51e7-4336-9930-c13ca7240615 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] http://10.222.0.73:9696/v2.0/extensions returned with HTTP 200 {{(pid=92013) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 16:37:37.200383 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-2c0727be-51e7-4336-9930-c13ca7240615 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0143108
May 25 16:37:37.201169 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8644550f-9ea2-4e6b-8886-500de06a0284 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:37.273346 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:37.300031 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8644550f-9ea2-4e6b-8886-500de06a0284 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:37.309623 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-8644550f-9ea2-4e6b-8886-500de06a0284 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.6089644
May 25 16:37:37.310497 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 50806) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:37.326161 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Network e55be10d-206c-4bb4-8273-c9b859b11a42 is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:37:37.339768 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c880ec1a-2cc6-46b8-a1a1-b097490a71da tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=fe57668427364ea7acb08a0f7f2826ed&fields=id HTTP/1.1" status: 200  len: 255 time: 0.4782758
May 25 16:37:37.342728 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:37.396160 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:37:37.418685 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Request body: {'floatingip': {'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:37.420391 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Notify callbacks [] for port, precommit_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:37.463213 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9525cbcf-cb95-4be4-8169-0cfeca7d7dd3 req-6fdce4fa-8895-414f-8d6c-121919a83e2e tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:37.466989 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Transition to ACTIVE for port object f4b0710d-b203-43ad-9bf9-b9df5851c043 will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:37:37.473145 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9525cbcf-cb95-4be4-8169-0cfeca7d7dd3 req-6fdce4fa-8895-414f-8d6c-121919a83e2e tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 932 time: 0.7119672
May 25 16:37:37.475230 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8644550f-9ea2-4e6b-8886-500de06a0284 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b8f2152d-a1fd-44f8-99be-7ef54edb6ca4,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:37.479923 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-8644550f-9ea2-4e6b-8886-500de06a0284 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:37.481034 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:37.558897 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50812) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:37.560203 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:37.566617 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Pushing event updated for resources: {'Port': ['ID=39034fee-da76-49d9-a359-2be89ce60575,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:37.581932 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.530s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:37.607590 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:37.739094 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:37.739780 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:37.839695 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Usage tracker for resource:floatingip and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:37.869833 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:37.873049 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c6d27645-be59-46a0-8071-212a99a907e8 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=8db80d29cff3449ea1aaeeeca73788bc&name=default HTTP/1.1" status: 200  len: 2975 time: 0.2827272
May 25 16:37:37.875985 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50820) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:37.891220 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:37.921245 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:37.963039 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 6.1625192
May 25 16:37:37.992428 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9525cbcf-cb95-4be4-8169-0cfeca7d7dd3 req-14f05900-c796-40c9-8b83-f18afd1ecef6 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5181224
May 25 16:37:38.207927 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d96bae7-f075-497a-bc88-6c125e46ad32 None None] Pushing event updated for resources: {'Port': ['ID=f4b0710d-b203-43ad-9bf9-b9df5851c043,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:38.222138 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-82bd920a-c7fc-4d13-9a24-a98e7c1078bf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:38.223513 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-0d96bae7-f075-497a-bc88-6c125e46ad32 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.614s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:38.335908 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port f766da42-735a-4b61-b332-9e92e16398ce completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:37:38.394255 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-82bd920a-c7fc-4d13-9a24-a98e7c1078bf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:38.500592 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Attempting to bind port f4b0710d-b203-43ad-9bf9-b9df5851c043 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:37:38.501135 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Attempting to bind port f4b0710d-b203-43ad-9bf9-b9df5851c043 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:37:38.501265 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Attempting to bind port f4b0710d-b203-43ad-9bf9-b9df5851c043 on network ce683266-622a-4b13-a610-301441bf2882 {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:37:38.508904 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port f766da42-735a-4b61-b332-9e92e16398ce triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:38.509484 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:38.562589 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-82bd920a-c7fc-4d13-9a24-a98e7c1078bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:38.570910 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:38.571944 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-9279f35c-8523-4edd-a56d-6a92a1623efa service neutron] 10.222.0.73 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=segments HTTP/1.1" status: 200  len: 212 time: 1.2307179
May 25 16:37:38.582995 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 37, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:37:38.583380 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Checking segment: {'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:38.583780 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:38.584173 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Bound using segment: {'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:37:38.584651 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Bound port: f4b0710d-b203-43ad-9bf9-b9df5851c043, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:37:38.585020 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:38.616989 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82bd920a-c7fc-4d13-9a24-a98e7c1078bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=037b8d79-e49c-4004-9015-cabf92360e90,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:38.629222 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-82bd920a-c7fc-4d13-9a24-a98e7c1078bf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:38.640696 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-82bd920a-c7fc-4d13-9a24-a98e7c1078bf admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:38.643346 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-82bd920a-c7fc-4d13-9a24-a98e7c1078bf admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/037b8d79-e49c-4004-9015-cabf92360e90 HTTP/1.1" status: 204  len: 168 time: 0.7470474
May 25 16:37:38.780547 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Request body: {'port': {'device_id': '202b7b00-4b4f-4282-b5ca-6e5f51a3a967', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:38.889859 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] For port f4b0710d-b203-43ad-9bf9-b9df5851c043, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:37:38.906171 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] For port f4b0710d-b203-43ad-9bf9-b9df5851c043, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=f4b0710d-b203-43ad-9bf9-b9df5851c043,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:37:38.916531 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:38.936947 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:38.992936 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Request body: {'port': {'device_id': 'a7788ff0-f301-463e-8b35-fead9db52a0c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:39.024410 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d96bae7-f075-497a-bc88-6c125e46ad32 None None] Pushing event updated for resources: {'Port': ['ID=f4b0710d-b203-43ad-9bf9-b9df5851c043,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:39.032761 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-0d96bae7-f075-497a-bc88-6c125e46ad32 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:39.054705 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:37:39.055364 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b79b250>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:37:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:39.151103 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:39.219597 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:39.395569 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-6008a601-5e2a-4e04-9bc2-28cdc79acc24 service neutron] 10.222.0.73 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.8015320
May 25 16:37:39.483818 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8a311cf-f8f5-4806-9ab4-61ab8777f650 req-b7ce1a8a-d4d3-49be-a45b-c7285fb045de tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:39.495593 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f8a311cf-f8f5-4806-9ab4-61ab8777f650 req-b7ce1a8a-d4d3-49be-a45b-c7285fb045de tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 931 time: 1.1553776
May 25 16:37:39.561018 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:37:39.689344 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f8a311cf-f8f5-4806-9ab4-61ab8777f650 req-67378f6a-16af-4682-81f2-7611d306e933 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1927791
May 25 16:37:39.702918 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:40.123130 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.76', 57600) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:40.285195 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:40.315579 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-631ad83a-4cfa-4a68-bf51-8983a2ea4516 req-486897cc-c59a-41b5-91d3-71941e1684ea tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 210 time: 0.3564010
May 25 16:37:40.332127 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.db.resource_extend [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] It took 0.21 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 25 16:37:40.575803 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50880) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:40.746424 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port f766da42-735a-4b61-b332-9e92e16398ce, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=f766da42-735a-4b61-b332-9e92e16398ce,segment=NetworkSegment(227f55be-6fbd-4206-b845-6ee4d0737571),segment_id=227f55be-6fbd-4206-b845-6ee4d0737571)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:37:40.807450 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:40.826697 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Allocated IP 172.27.3.254 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/3cff790e-1327-438f-afcc-8b654a7a28db) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:37:40.846466 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:41.124660 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device f4b0710d-b203-43ad-9bf9-b9df5851c043 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:37:41.237671 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-8d6fbbd2-efa5-4177-ab9a-f5b45ec5aa81 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=507935d4b65048e2827b6ea3ce8041af&name=default HTTP/1.1" status: 200  len: 2975 time: 0.6411257
May 25 16:37:41.244081 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d6963172-fb53-4ee4-95ea-1609b9d40db4 {{(pid=92012) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:37:41.270217 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 50902) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:41.338477 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:41.364250 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=f766da42-735a-4b61-b332-9e92e16398ce,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:41.378066 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.531s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:41.433807 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:41.450444 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b79b250>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:38Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:37:41.466179 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port f4b0710d-b203-43ad-9bf9-b9df5851c043 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:37:41.475712 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99a2937a-3c19-4cf1-a60c-c7ca5b9cb8cb None None] The sync data for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi is: [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:38Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:37:41.488228 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port f4b0710d-b203-43ad-9bf9-b9df5851c043 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:41.489495 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:41.495578 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-a2889c74-8a70-40c4-aa55-02a5f4293839 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:41.499447 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-a2889c74-8a70-40c4-aa55-02a5f4293839 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Synchronizing usage tracker for tenant:fe57668427364ea7acb08a0f7f2826ed on resource:network {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:37:41.555995 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Transition to ACTIVE for port object d6963172-fb53-4ee4-95ea-1609b9d40db4 will not be triggered until provisioned by entity L2. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:37:41.557585 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3bbfa19a-fd84-48bd-97ef-a9b6abae02eb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:41.560017 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-a2889c74-8a70-40c4-aa55-02a5f4293839 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Unset dirty status for tenant:fe57668427364ea7acb08a0f7f2826ed on resource:network {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:37:41.561605 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-a2889c74-8a70-40c4-aa55-02a5f4293839 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.76 "GET /v2.0/networks?id=1186d694-166f-4246-b68b-e7ce60cb0f02 HTTP/1.1" status: 200  len: 817 time: 1.4347425
May 25 16:37:41.578925 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:41.619487 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3bbfa19a-fd84-48bd-97ef-a9b6abae02eb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:41.704029 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:41.854375 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3bbfa19a-fd84-48bd-97ef-a9b6abae02eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:41.859022 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:41.862505 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15bd11d3-966d-4d01-963a-a8564b8190dc req-31933682-ccff-45d0-8c8a-129c543cf812 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:41.864590 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-15bd11d3-966d-4d01-963a-a8564b8190dc req-31933682-ccff-45d0-8c8a-129c543cf812 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 932 time: 1.7173245
May 25 16:37:41.905308 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port f4b0710d-b203-43ad-9bf9-b9df5851c043, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=f4b0710d-b203-43ad-9bf9-b9df5851c043,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:37:41.916053 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:41.921583 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:42.003669 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=f4b0710d-b203-43ad-9bf9-b9df5851c043,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:42.007393 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:42.024656 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Pushing event updated for resources: {'Port': ['ID=d6963172-fb53-4ee4-95ea-1609b9d40db4,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:42.028282 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.324s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:42.039830 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.134s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:42.078344 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:42.101580 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3bbfa19a-fd84-48bd-97ef-a9b6abae02eb admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:42.105470 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-3bbfa19a-fd84-48bd-97ef-a9b6abae02eb admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/a03e23e0-41cf-4f14-aa2f-e78425272ba5 HTTP/1.1" status: 204  len: 168 time: 0.8100538
May 25 16:37:42.134352 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bbfa19a-fd84-48bd-97ef-a9b6abae02eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a03e23e0-41cf-4f14-aa2f-e78425272ba5,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:42.144411 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3bbfa19a-fd84-48bd-97ef-a9b6abae02eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:42.145235 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ad5db26-8b8a-4e77-b448-57c4a0405c6c req-9056d08e-092c-4428-bde3-804419a77059 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:42.146831 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4ad5db26-8b8a-4e77-b448-57c4a0405c6c req-9056d08e-092c-4428-bde3-804419a77059 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 931 time: 1.0387852
May 25 16:37:42.230021 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Attempting to bind port d6963172-fb53-4ee4-95ea-1609b9d40db4 on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:37:42.230594 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Attempting to bind port d6963172-fb53-4ee4-95ea-1609b9d40db4 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': 'b1e2e8a0-c79b-42fe-a4d3-171a8ed15717', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 416, 'network_id': '48fa5bbf-9d42-4b66-8b53-a15b499d3d14'}] {{(pid=92012) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:37:42.231026 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Attempting to bind port d6963172-fb53-4ee4-95ea-1609b9d40db4 on network 48fa5bbf-9d42-4b66-8b53-a15b499d3d14 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:37:42.239185 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Port d6963172-fb53-4ee4-95ea-1609b9d40db4 on network 48fa5bbf-9d42-4b66-8b53-a15b499d3d14 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:37:42.239812 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Attempting to bind port d6963172-fb53-4ee4-95ea-1609b9d40db4 on network 48fa5bbf-9d42-4b66-8b53-a15b499d3d14 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:37:42.244704 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-15bd11d3-966d-4d01-963a-a8564b8190dc req-a0ea5161-db23-466b-8d78-e5fcf6c8a9f3 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3397691
May 25 16:37:42.247426 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 37, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:37:42.247848 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Checking segment: {'id': 'b1e2e8a0-c79b-42fe-a4d3-171a8ed15717', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 416, 'network_id': '48fa5bbf-9d42-4b66-8b53-a15b499d3d14'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:42.248445 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Bound using segment: {'id': 'b1e2e8a0-c79b-42fe-a4d3-171a8ed15717', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 416, 'network_id': '48fa5bbf-9d42-4b66-8b53-a15b499d3d14'} {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:37:42.249002 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Bound port: d6963172-fb53-4ee4-95ea-1609b9d40db4, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b1e2e8a0-c79b-42fe-a4d3-171a8ed15717', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 416, 'network_id': '48fa5bbf-9d42-4b66-8b53-a15b499d3d14'}}] {{(pid=92012) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:37:42.249507 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:42.410678 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4ad5db26-8b8a-4e77-b448-57c4a0405c6c req-54696817-765a-434e-94bb-d5b3ebb57c33 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2458053
May 25 16:37:42.452232 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] For port d6963172-fb53-4ee4-95ea-1609b9d40db4, host hv-cinder-78638, cleared binding levels {{(pid=92012) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:37:42.458377 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] For port d6963172-fb53-4ee4-95ea-1609b9d40db4, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d6963172-fb53-4ee4-95ea-1609b9d40db4,segment=NetworkSegment(b1e2e8a0-c79b-42fe-a4d3-171a8ed15717),segment_id=b1e2e8a0-c79b-42fe-a4d3-171a8ed15717)] {{(pid=92012) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:37:42.470941 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:42.485189 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-286fedaf-a6be-40a7-bf65-da6c52296e27 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:42.531382 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-27f0ea05-6336-4495-96be-73fc14f5eb5e req-9e903ca2-6203-45dc-b9fc-faea4f078b41 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 210 time: 0.0836833
May 25 16:37:42.548747 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:42.561246 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:42.646603 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:42.647232 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:42.648791 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] 10.222.0.76 "PUT /v2.0/ports/d6963172-fb53-4ee4-95ea-1609b9d40db4 HTTP/1.1" status: 200  len: 1094 time: 4.4148073
May 25 16:37:42.649257 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '202b7b00-4b4f-4282-b5ca-6e5f51a3a967', 'tag': 'd6963172-fb53-4ee4-95ea-1609b9d40db4'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:37:42.706340 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Pushing event updated for resources: {'Port': ['ID=d6963172-fb53-4ee4-95ea-1609b9d40db4,revision_number=3']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:42.710474 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:42.731103 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:37:42.736237 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:42.754719 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:37:42.760625 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 39034fee-da76-49d9-a359-2be89ce60575 {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:37:42.871507 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:42.874969 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event updated for resources: {'Port': ['ID=3cff790e-1327-438f-afcc-8b654a7a28db,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:42.889839 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:42.908633 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Transition to ACTIVE for port object 39034fee-da76-49d9-a359-2be89ce60575 will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:37:42.918816 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:42.922910 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:42.937856 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:43.015314 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device f4b0710d-b203-43ad-9bf9-b9df5851c043 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:37:43.119196 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port f4b0710d-b203-43ad-9bf9-b9df5851c043 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:43.119696 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:43.169851 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '202b7b00-4b4f-4282-b5ca-6e5f51a3a967', 'tag': 'd6963172-fb53-4ee4-95ea-1609b9d40db4', 'status': 'completed', 'code': 200}
May 25 16:37:43.263208 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device f766da42-735a-4b61-b332-9e92e16398ce up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:37:43.285504 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Pushing event updated for resources: {'Port': ['ID=39034fee-da76-49d9-a359-2be89ce60575,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:43.327436 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.389s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:43.328459 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:43.364688 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port f766da42-735a-4b61-b332-9e92e16398ce triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:43.365305 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:43.422512 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Attempting to bind port 39034fee-da76-49d9-a359-2be89ce60575 on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:37:43.422784 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Attempting to bind port 39034fee-da76-49d9-a359-2be89ce60575 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:37:43.423320 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Attempting to bind port 39034fee-da76-49d9-a359-2be89ce60575 on network e55be10d-206c-4bb4-8273-c9b859b11a42 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:37:43.447142 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Port 39034fee-da76-49d9-a359-2be89ce60575 on network e55be10d-206c-4bb4-8273-c9b859b11a42 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:37:43.447410 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Attempting to bind port 39034fee-da76-49d9-a359-2be89ce60575 on network e55be10d-206c-4bb4-8273-c9b859b11a42 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:37:43.473843 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 37, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:37:43.474184 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Checking segment: {'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:43.474780 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Bound using segment: {'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:37:43.475271 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Bound port: 39034fee-da76-49d9-a359-2be89ce60575, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:37:43.475620 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:43.740505 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7882064-aa2c-4031-922d-4a427da30aa0 req-5ea04a57-288c-46dc-a66d-fff895f54103 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:43.742169 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b7882064-aa2c-4031-922d-4a427da30aa0 req-5ea04a57-288c-46dc-a66d-fff895f54103 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 944 time: 0.3602967
May 25 16:37:43.777596 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] For port 39034fee-da76-49d9-a359-2be89ce60575, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:37:43.815965 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] For port 39034fee-da76-49d9-a359-2be89ce60575, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=39034fee-da76-49d9-a359-2be89ce60575,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:37:43.835261 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:43.853784 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b39346b7-5b6b-42fa-87cd-f07834a3d223 req-1b64fc0a-5a52-4338-b52c-fcf451da7df1 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:43.855271 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b39346b7-5b6b-42fa-87cd-f07834a3d223 req-1b64fc0a-5a52-4338-b52c-fcf451da7df1 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 943 time: 0.2959538
May 25 16:37:43.858136 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-b43de1e0-022c-4795-9014-4a3fb37342be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:43.893593 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b7882064-aa2c-4031-922d-4a427da30aa0 req-09728443-453d-489c-998b-862fa0d05450 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1425030
May 25 16:37:43.970993 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:43.971609 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:43.972970 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] 10.222.0.76 "PUT /v2.0/ports/39034fee-da76-49d9-a359-2be89ce60575 HTTP/1.1" status: 200  len: 1093 time: 5.6796417
May 25 16:37:43.974883 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:43.978708 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a7788ff0-f301-463e-8b35-fead9db52a0c', 'tag': '39034fee-da76-49d9-a359-2be89ce60575'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:37:44.051469 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:44.111488 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b60d96e6-0121-4a04-8747-b58bfd2b6e7d req-77018652-3c39-4993-9e14-6dfaa39c2a88 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 210 time: 0.0786071
May 25 16:37:44.114320 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b39346b7-5b6b-42fa-87cd-f07834a3d223 req-579ebf67-b4c1-4b1f-8e24-ad74087be613 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2141342
May 25 16:37:44.114921 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Pushing event updated for resources: {'Port': ['ID=39034fee-da76-49d9-a359-2be89ce60575,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:44.120165 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.262s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:44.120790 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.013s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:44.166504 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:44.227447 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event updated for resources: {'Port': ['ID=3cff790e-1327-438f-afcc-8b654a7a28db,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:44.234355 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:44.237248 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:44.240821 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 6.8430438
May 25 16:37:44.546298 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a7788ff0-f301-463e-8b35-fead9db52a0c', 'tag': '39034fee-da76-49d9-a359-2be89ce60575', 'status': 'completed', 'code': 200}
May 25 16:37:44.749298 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-594dbeab-b657-4fca-83ee-bfc0004193b7 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Synchronizing usage tracker for tenant:63f896ab0d7e44158204551033c33ba4 on resource:security_group {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:37:44.778886 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-594dbeab-b657-4fca-83ee-bfc0004193b7 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Unset dirty status for tenant:63f896ab0d7e44158204551033c33ba4 on resource:security_group {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:37:44.787144 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-594dbeab-b657-4fca-83ee-bfc0004193b7 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?name=tempest-securitygroup--1455889409&fields=id&tenant_id=63f896ab0d7e44158204551033c33ba4 HTTP/1.1" status: 200  len: 267 time: 0.1095378
May 25 16:37:44.947592 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-da3923e1-ef72-4e50-8001-13dffe0ef901 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:44.948302 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-da3923e1-ef72-4e50-8001-13dffe0ef901 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Synchronizing usage tracker for tenant:63f896ab0d7e44158204551033c33ba4 on resource:network {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:37:44.986504 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-da3923e1-ef72-4e50-8001-13dffe0ef901 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Unset dirty status for tenant:63f896ab0d7e44158204551033c33ba4 on resource:network {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:37:44.987937 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-da3923e1-ef72-4e50-8001-13dffe0ef901 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/networks?id=ce683266-622a-4b13-a610-301441bf2882 HTTP/1.1" status: 200  len: 811 time: 0.2000165
May 25 16:37:45.009217 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-74c33741-3c94-476b-a2a1-6f9892a5c886 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/quotas/63f896ab0d7e44158204551033c33ba4 HTTP/1.1" status: 200  len: 375 time: 0.0110548
May 25 16:37:45.199438 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-88191a62-0830-42e9-acca-651529e0f5c3 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Synchronizing usage tracker for tenant:63f896ab0d7e44158204551033c33ba4 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:37:45.211542 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986882b5-2136-45ca-bd0d-7c27fca8ef0d req-a9fe8873-392f-4901-9551-ef5dd38cd75a tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:45.213927 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-986882b5-2136-45ca-bd0d-7c27fca8ef0d req-a9fe8873-392f-4901-9551-ef5dd38cd75a tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 944 time: 0.1308191
May 25 16:37:45.265306 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-88191a62-0830-42e9-acca-651529e0f5c3 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Unset dirty status for tenant:63f896ab0d7e44158204551033c33ba4 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:37:45.277646 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-88191a62-0830-42e9-acca-651529e0f5c3 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=63f896ab0d7e44158204551033c33ba4&fields=id HTTP/1.1" status: 200  len: 348 time: 0.2549865
May 25 16:37:45.342159 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-986882b5-2136-45ca-bd0d-7c27fca8ef0d req-57effa98-79c7-43e9-af5f-a43884a00f20 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1134295
May 25 16:37:45.544586 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-437c9261-6ae8-4bd8-91ac-b29d9fa98d19 service neutron] 10.222.0.73 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2578473
May 25 16:37:45.586809 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0fec6dd9-4ea8-438d-bf90-848c60e768d8 req-7a96bdd4-8572-4e85-9989-65e4f5dd30df tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 210 time: 0.1015260
May 25 16:37:45.646366 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51068) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:45.805449 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-22f0d858-46f1-4415-bf3c-6369fe9b7403 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:45.814421 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-39488abf-1937-4edc-87cb-518f8abc803c service neutron] 10.222.0.73 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2633276
May 25 16:37:45.823303 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-22f0d858-46f1-4415-bf3c-6369fe9b7403 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:45.827760 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-22f0d858-46f1-4415-bf3c-6369fe9b7403 admin admin] Usage tracker for resource:security_group_rule and tenant:a2c55f2f355949138a2bc80adb18d149 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:45.831797 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-22f0d858-46f1-4415-bf3c-6369fe9b7403 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:45.839729 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-22f0d858-46f1-4415-bf3c-6369fe9b7403 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:45.866762 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3173f12-8a31-4764-8e8d-90c060a2e3f3 req-87633de4-a106-4bcc-96db-952cba81f42c tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:45.876388 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b3173f12-8a31-4764-8e8d-90c060a2e3f3 req-87633de4-a106-4bcc-96db-952cba81f42c tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 943 time: 0.1386609
May 25 16:37:45.964679 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b3173f12-8a31-4764-8e8d-90c060a2e3f3 req-de18718f-e6ac-46c7-9ca9-0b6f8de80e72 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0783815
May 25 16:37:46.011210 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-22f0d858-46f1-4415-bf3c-6369fe9b7403 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:46.024827 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-22f0d858-46f1-4415-bf3c-6369fe9b7403 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:46.035794 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f7ec52b8-8468-47ce-9ed8-690e87aba226 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:46.098109 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-22f0d858-46f1-4415-bf3c-6369fe9b7403 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=a2c55f2f355949138a2bc80adb18d149&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4499207
May 25 16:37:46.099010 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22f0d858-46f1-4415-bf3c-6369fe9b7403 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=380b4dca-018d-45f3-9f73-d7b3638778aa,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:46.114235 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51086) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:46.116509 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-22f0d858-46f1-4415-bf3c-6369fe9b7403 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:46.210264 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1a784683-79af-497b-82de-654bf69b2cf7 req-08de98ea-0c4e-4199-8832-7869649b7aaa tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 210 time: 0.1331198
May 25 16:37:46.241727 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-064420cc-9b20-4796-ac5d-c8b698037790 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:46.317328 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-064420cc-9b20-4796-ac5d-c8b698037790 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:46.417291 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-064420cc-9b20-4796-ac5d-c8b698037790 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:46.422288 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:46.465125 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-064420cc-9b20-4796-ac5d-c8b698037790 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=380b4dca-018d-45f3-9f73-d7b3638778aa,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:46.491246 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-064420cc-9b20-4796-ac5d-c8b698037790 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:46.505525 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-064420cc-9b20-4796-ac5d-c8b698037790 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:46.508772 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-064420cc-9b20-4796-ac5d-c8b698037790 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/380b4dca-018d-45f3-9f73-d7b3638778aa HTTP/1.1" status: 204  len: 168 time: 0.3900020
May 25 16:37:46.777025 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Request body: {'port': {'device_id': '9f035b9c-0d0a-439e-80aa-646a77153848', 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02', 'admin_state_up': True, 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:46.827545 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a5d65b9-c431-4b99-8222-1ae06eb308c7 req-44db000f-962b-4311-8221-06bffb724324 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:46.836878 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7a5d65b9-c431-4b99-8222-1ae06eb308c7 req-44db000f-962b-4311-8221-06bffb724324 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 944 time: 0.3271847
May 25 16:37:47.017283 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b151ea16-3da6-47fb-9c45-c90ab4728737 req-8266ca74-46b8-4f8a-8bb3-60066d2ae3e6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 210 time: 0.2005558
May 25 16:37:47.173163 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7a5d65b9-c431-4b99-8222-1ae06eb308c7 req-4d2749fb-579c-4530-b2ab-8505c62cfa0c tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3352988
May 25 16:37:47.243474 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:47.250558 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Usage tracker for resource:port and tenant:fe57668427364ea7acb08a0f7f2826ed is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:47.254737 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Quota usage for port was recalculated. Used quota:1. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:47.281116 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-22e7b92c-2ab0-4e47-b4e8-dd5d0d132fb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:47.292372 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-22e7b92c-2ab0-4e47-b4e8-dd5d0d132fb6 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=2441ab18acee4d4c9e276ba69a458348&device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 1096 time: 0.3174374
May 25 16:37:47.294238 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 51124) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:47.309299 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:47.353371 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Made reservation on behalf of fe57668427364ea7acb08a0f7f2826ed for: {'port': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:47.359233 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:47.458907 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7837eb-6a08-46b5-a41e-7135a53b65b4 req-fa1de1e4-7b04-42e7-9112-f21882d70b19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:47.461489 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-0a7837eb-6a08-46b5-a41e-7135a53b65b4 req-fa1de1e4-7b04-42e7-9112-f21882d70b19 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=5d60da5ade5b4981948179f148ef1f56&device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 1097 time: 0.2027600
May 25 16:37:47.580139 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-93675430-b64e-4ef1-977a-bdbcf551e100 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:47.595375 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4d47f80c-eec3-4f7c-88c7-159e2ee0753e req-35eb14f1-92dc-4380-8c44-50a155c4e3b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 210 time: 0.0864382
May 25 16:37:47.622114 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-efddb8ba-d63b-43b1-b6f5-b5c4851ca1a8 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=39034fee-da76-49d9-a359-2be89ce60575 HTTP/1.1" status: 200  len: 217 time: 0.2807536
May 25 16:37:47.636936 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-93675430-b64e-4ef1-977a-bdbcf551e100 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:47.648916 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-93675430-b64e-4ef1-977a-bdbcf551e100 admin admin] Usage tracker for resource:security_group_rule and tenant:2264f1cc29d148a3a3469c78a66c0dd8 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:47.653541 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-93675430-b64e-4ef1-977a-bdbcf551e100 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:47.707843 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-93675430-b64e-4ef1-977a-bdbcf551e100 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:47.787678 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Allocated IP 172.20.0.12 (1186d694-166f-4246-b68b-e7ce60cb0f02/5e6146eb-31ff-437b-a594-8ddb1d63042e/ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:37:47.793311 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7837eb-6a08-46b5-a41e-7135a53b65b4 req-fc34779b-5107-4188-bd0a-fadc60e9aba9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:47.795020 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-0a7837eb-6a08-46b5-a41e-7135a53b65b4 req-fc34779b-5107-4188-bd0a-fadc60e9aba9 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=5d60da5ade5b4981948179f148ef1f56&shared=False HTTP/1.1" status: 200  len: 912 time: 0.3200595
May 25 16:37:47.808449 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-bbc90283-611b-471f-b3f6-4ef00292d412 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:47.810389 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-bbc90283-611b-471f-b3f6-4ef00292d412 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c4c2aef1-f957-410f-9038-a1d13568aa6e HTTP/1.1" status: 200  len: 854 time: 0.1536736
May 25 16:37:47.821869 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d6e89b9-5477-4b94-b74c-03fecad2e795 req-da06273f-42bc-428b-9ff3-8cb121a6cfb0 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:47.823765 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7d6e89b9-5477-4b94-b74c-03fecad2e795 req-da06273f-42bc-428b-9ff3-8cb121a6cfb0 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 943 time: 0.3829477
May 25 16:37:47.928300 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7d6e89b9-5477-4b94-b74c-03fecad2e795 req-6177a521-5c5b-49d1-abc1-c757d0395b4a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0961525
May 25 16:37:47.963100 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-93675430-b64e-4ef1-977a-bdbcf551e100 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:47.970025 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-93675430-b64e-4ef1-977a-bdbcf551e100 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:47.977316 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ebf9ccef-1511-4e37-9d83-fab451b30bac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:48.018683 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93675430-b64e-4ef1-977a-bdbcf551e100 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=073abd00-6754-4ad6-a81b-4c6bcf5c3a6d,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:48.024830 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-93675430-b64e-4ef1-977a-bdbcf551e100 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=2264f1cc29d148a3a3469c78a66c0dd8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7270727
May 25 16:37:48.024830 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-93675430-b64e-4ef1-977a-bdbcf551e100 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:48.026137 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 51144) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:48.062168 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:48.092043 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-834481ae-8cf6-4196-83a5-81bd07e8c359 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:48.102085 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:48.109197 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:48.121017 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-834481ae-8cf6-4196-83a5-81bd07e8c359 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:48.176465 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Network 1186d694-166f-4246-b68b-e7ce60cb0f02 is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:37:48.180359 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:48.182890 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:37:48.199928 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4381f6fc-8d6e-49fd-892d-abd993f1ec6a req-42e684de-f25f-48ef-87a8-d697fa1c6c02 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 210 time: 0.0606303
May 25 16:37:48.235614 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Pushing event updated for resources: {'Port': ['ID=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:48.241579 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:48.245605 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-834481ae-8cf6-4196-83a5-81bd07e8c359 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:48.253093 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:48.267049 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:48.267727 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-834481ae-8cf6-4196-83a5-81bd07e8c359 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=073abd00-6754-4ad6-a81b-4c6bcf5c3a6d,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:48.267831 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:48.272100 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-834481ae-8cf6-4196-83a5-81bd07e8c359 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:48.279037 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-834481ae-8cf6-4196-83a5-81bd07e8c359 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:48.282365 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-834481ae-8cf6-4196-83a5-81bd07e8c359 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/073abd00-6754-4ad6-a81b-4c6bcf5c3a6d HTTP/1.1" status: 204  len: 168 time: 0.2529798
May 25 16:37:48.306020 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.5330603
May 25 16:37:48.406880 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24c75936-9094-4751-b282-bf1aec408973 req-216949c5-8b6f-4698-9043-1705fb09d5af tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:48.409868 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-24c75936-9094-4751-b282-bf1aec408973 req-216949c5-8b6f-4698-9043-1705fb09d5af tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 944 time: 0.0880747
May 25 16:37:48.457502 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-24c75936-9094-4751-b282-bf1aec408973 req-63bb3cb4-45a7-413d-b12e-1f8aba036c8e tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427101
May 25 16:37:48.496202 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:37:48.783137 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-016f6db6-e610-43b1-8425-25d7fe58b037 req-88027527-1833-4514-bab3-4bf1d3aab2c5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 210 time: 0.0582490
May 25 16:37:49.125949 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-210f5db3-3097-4ba8-bc49-87ebb4c6671e req-6d3dda10-15ff-4420-9089-737d66f010c4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:49.127429 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-210f5db3-3097-4ba8-bc49-87ebb4c6671e req-6d3dda10-15ff-4420-9089-737d66f010c4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 943 time: 0.0835650
May 25 16:37:49.177428 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-210f5db3-3097-4ba8-bc49-87ebb4c6671e req-ce26e215-c614-4a2d-a32b-0ca487f70056 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433104
May 25 16:37:49.364516 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-57f8f1e6-ec3e-4f7b-b9e5-d271ee661db1 req-3ac68392-fde1-4b45-ac2d-0d45b2b26d7d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 210 time: 0.0480623
May 25 16:37:49.651777 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56ac0921-ffce-4c6a-b132-067ddcd996a7 req-3f738caa-0681-4162-8205-c7134e42a0e4 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:49.653266 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-56ac0921-ffce-4c6a-b132-067ddcd996a7 req-3f738caa-0681-4162-8205-c7134e42a0e4 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 944 time: 0.0796309
May 25 16:37:49.699110 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-56ac0921-ffce-4c6a-b132-067ddcd996a7 req-b2e76259-1973-4fed-8e19-998eda09d03b tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401196
May 25 16:37:49.938440 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7764e053-376c-4e80-98c9-b1579c0867e0 req-dd766bed-41b2-4bf7-9f39-aed041871bfd tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 210 time: 0.0456896
May 25 16:37:50.373485 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceea64a0-2709-4c47-8722-d29f6a94ae9f req-ee3330ea-7f8a-4abf-b940-042c94bf240c tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:50.374913 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ceea64a0-2709-4c47-8722-d29f6a94ae9f req-ee3330ea-7f8a-4abf-b940-042c94bf240c tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 943 time: 0.0868983
May 25 16:37:50.434787 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ceea64a0-2709-4c47-8722-d29f6a94ae9f req-e316c528-a045-45a3-875d-53eea526b05f tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0481150
May 25 16:37:50.499997 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51242) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:50.535484 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b1ab63c4-8c68-4f74-9cdd-e9dd9c34df02 req-48ab1ff7-efaa-46f6-930d-f593730799e5 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 210 time: 0.0463388
May 25 16:37:50.646822 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c296ff08-5b47-4194-a98a-2e60cc29ec30 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:50.661924 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c296ff08-5b47-4194-a98a-2e60cc29ec30 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:50.666217 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c296ff08-5b47-4194-a98a-2e60cc29ec30 admin admin] Usage tracker for resource:security_group_rule and tenant:5e64d986fd6f40878bd9b0e06ed3b8d6 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:50.669736 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c296ff08-5b47-4194-a98a-2e60cc29ec30 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:50.676408 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c296ff08-5b47-4194-a98a-2e60cc29ec30 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:50.789462 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c296ff08-5b47-4194-a98a-2e60cc29ec30 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:50.793475 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c296ff08-5b47-4194-a98a-2e60cc29ec30 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:50.801504 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0c010958-b7ab-483f-a517-6175ecb0614b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:50.851334 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c296ff08-5b47-4194-a98a-2e60cc29ec30 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=5e64d986fd6f40878bd9b0e06ed3b8d6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3501971
May 25 16:37:50.852276 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c296ff08-5b47-4194-a98a-2e60cc29ec30 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=870c3d8b-59e8-4cf9-8123-062ac66b5ba7,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:50.854773 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 51250) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:50.856245 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c296ff08-5b47-4194-a98a-2e60cc29ec30 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:50.887119 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.76', 57616) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:50.983742 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-08785f40-2270-4fe3-b35c-a110201e3c3b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e55be10d-206c-4bb4-8273-c9b859b11a42&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0976462
May 25 16:37:51.097272 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Request body: {'port': {'device_id': '9f035b9c-0d0a-439e-80aa-646a77153848', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:51.188231 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7837eb-6a08-46b5-a41e-7135a53b65b4 req-4072e0da-b09f-4fd2-9e85-08b150248fa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:51.190111 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-0a7837eb-6a08-46b5-a41e-7135a53b65b4 req-4072e0da-b09f-4fd2-9e85-08b150248fa5 service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.3183124
May 25 16:37:51.286128 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:51.331687 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-93dff06a-6095-4050-902f-b45487d4e054 req-10477886-16df-4f6a-823e-10922bf6b935 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 210 time: 0.1932406
May 25 16:37:51.364750 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05160eeb-a422-48b0-87fb-22a48abe82b5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:51.409844 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b16eba1f-26a0-4de1-8028-99ecad2bfb58 req-50860c50-482f-40d6-9b52-a35a80c92a79 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:51.411331 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b16eba1f-26a0-4de1-8028-99ecad2bfb58 req-50860c50-482f-40d6-9b52-a35a80c92a79 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 944 time: 0.6027660
May 25 16:37:51.466990 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-6bf26a02-1c1f-4378-a85b-edffb03ebe70 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4318266
May 25 16:37:51.477596 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05160eeb-a422-48b0-87fb-22a48abe82b5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:51.501847 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-240e4c54-15db-43b9-9ec1-19505b8cb3be tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:51.503984 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-240e4c54-15db-43b9-9ec1-19505b8cb3be tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.76 "GET /v2.0/networks?id=1186d694-166f-4246-b68b-e7ce60cb0f02 HTTP/1.1" status: 200  len: 817 time: 0.6152182
May 25 16:37:51.550017 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b16eba1f-26a0-4de1-8028-99ecad2bfb58 req-491713a0-ed28-49c1-8fd5-177c5eca105b tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1251695
May 25 16:37:51.580836 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05160eeb-a422-48b0-87fb-22a48abe82b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:51.590578 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-1118cafe-2ecc-4d42-ab99-4ba717f2bd39 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:51.649750 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05160eeb-a422-48b0-87fb-22a48abe82b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=870c3d8b-59e8-4cf9-8123-062ac66b5ba7,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:51.654664 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-05160eeb-a422-48b0-87fb-22a48abe82b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:51.674072 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05160eeb-a422-48b0-87fb-22a48abe82b5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:51.675951 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-05160eeb-a422-48b0-87fb-22a48abe82b5 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/870c3d8b-59e8-4cf9-8123-062ac66b5ba7 HTTP/1.1" status: 204  len: 168 time: 0.8195331
May 25 16:37:51.775968 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d {{(pid=92012) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:37:51.783557 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:51.798646 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Transition to ACTIVE for port object ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d will not be triggered until provisioned by entity L2. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:37:51.805141 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:51.813755 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e2ba9806-1748-4d7a-aa97-33e78bf2f5a1 req-b2854e3f-078d-4612-8874-5499e520f368 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 210 time: 0.0868626
May 25 16:37:51.817512 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:51.828312 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-778e82bc-0908-4eb5-b72b-837ff4190937 req-a8ce2ad4-8268-4942-b36e-dbdb2f1787d9 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:51.837984 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-778e82bc-0908-4eb5-b72b-837ff4190937 req-a8ce2ad4-8268-4942-b36e-dbdb2f1787d9 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 943 time: 0.2337999
May 25 16:37:51.892296 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-778e82bc-0908-4eb5-b72b-837ff4190937 req-4f1d8008-c623-4872-aaa2-a600dc676c06 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0532537
May 25 16:37:52.037366 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Pushing event updated for resources: {'Port': ['ID=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:52.040559 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:52.043191 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 51278) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:52.062309 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40c3b7d6-6625-4cba-81fb-3e45fd3f7e0b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:52.077986 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-40c3b7d6-6625-4cba-81fb-3e45fd3f7e0b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:52.078328 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Attempting to bind port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:37:52.078661 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Attempting to bind port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '227f55be-6fbd-4206-b845-6ee4d0737571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02'}] {{(pid=92012) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:37:52.078977 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Attempting to bind port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d on network 1186d694-166f-4246-b68b-e7ce60cb0f02 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:37:52.083314 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-40c3b7d6-6625-4cba-81fb-3e45fd3f7e0b admin admin] Usage tracker for resource:security_group_rule and tenant:e48bdeb7dc414fc5878333ac726016c6 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:52.083902 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d on network 1186d694-166f-4246-b68b-e7ce60cb0f02 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:37:52.084211 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Attempting to bind port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d on network 1186d694-166f-4246-b68b-e7ce60cb0f02 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:37:52.086388 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-40c3b7d6-6625-4cba-81fb-3e45fd3f7e0b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:52.089808 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 37, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:37:52.090132 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Checking segment: {'id': '227f55be-6fbd-4206-b845-6ee4d0737571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:52.090500 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Bound using segment: {'id': '227f55be-6fbd-4206-b845-6ee4d0737571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02'} {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:37:52.090922 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Bound port: ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '227f55be-6fbd-4206-b845-6ee4d0737571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02'}}] {{(pid=92012) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:37:52.091537 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:52.092225 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-40c3b7d6-6625-4cba-81fb-3e45fd3f7e0b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:52.183796 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40c3b7d6-6625-4cba-81fb-3e45fd3f7e0b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:52.188397 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-40c3b7d6-6625-4cba-81fb-3e45fd3f7e0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:52.190195 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] For port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d, host hv-cinder-78638, cleared binding levels {{(pid=92012) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:37:52.194369 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] For port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d,segment=NetworkSegment(227f55be-6fbd-4206-b845-6ee4d0737571),segment_id=227f55be-6fbd-4206-b845-6ee4d0737571)] {{(pid=92012) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:37:52.199044 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:52.199435 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-834481ae-8cf6-4196-83a5-81bd07e8c359 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:52.204119 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:52.252501 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-40c3b7d6-6625-4cba-81fb-3e45fd3f7e0b admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=e48bdeb7dc414fc5878333ac726016c6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2081153
May 25 16:37:52.253886 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40c3b7d6-6625-4cba-81fb-3e45fd3f7e0b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=710c2a2e-6c10-42f2-86dd-8eeff352bed2,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:52.255977 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51286) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:52.257687 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-40c3b7d6-6625-4cba-81fb-3e45fd3f7e0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:52.295559 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:52.296179 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:52.297787 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] 10.222.0.76 "PUT /v2.0/ports/ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d HTTP/1.1" status: 200  len: 1094 time: 1.2049987
May 25 16:37:52.300992 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9f035b9c-0d0a-439e-80aa-646a77153848', 'tag': 'ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:37:52.364308 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Pushing event updated for resources: {'Port': ['ID=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d,revision_number=3']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:52.364308 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:52.382012 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9f035b9c-0d0a-439e-80aa-646a77153848', 'tag': 'ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d', 'status': 'completed', 'code': 200}
May 25 16:37:52.389447 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b84c5399-74e0-45a8-8367-70f7d06fe657 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:52.420825 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b84c5399-74e0-45a8-8367-70f7d06fe657 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:52.482345 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b84c5399-74e0-45a8-8367-70f7d06fe657 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:52.487181 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-feac4c78-530f-4ccf-83e1-75526c985d96 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:52.501432 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b84c5399-74e0-45a8-8367-70f7d06fe657 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=710c2a2e-6c10-42f2-86dd-8eeff352bed2,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:52.504366 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b84c5399-74e0-45a8-8367-70f7d06fe657 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:52.507379 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39e47a8f-e48d-44a1-bf16-23666ff1d15b req-133b89f4-e401-4f79-aac6-6faf373f0bfe tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 210 time: 0.0444398
May 25 16:37:52.515143 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b84c5399-74e0-45a8-8367-70f7d06fe657 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:52.516251 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-b84c5399-74e0-45a8-8367-70f7d06fe657 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/710c2a2e-6c10-42f2-86dd-8eeff352bed2 HTTP/1.1" status: 204  len: 168 time: 0.2519591
May 25 16:37:52.780741 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9551f09c-f351-497e-9ac8-b9798f6b2008 req-df306381-7e61-44ba-98ff-b619a453494d tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:52.782248 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9551f09c-f351-497e-9ac8-b9798f6b2008 req-df306381-7e61-44ba-98ff-b619a453494d tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 944 time: 0.0864522
May 25 16:37:52.835957 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9551f09c-f351-497e-9ac8-b9798f6b2008 req-74872735-f19b-4b55-8304-e548d5ed8ca6 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0467074
May 25 16:37:53.006081 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-db57053d-ece8-440e-b679-ad24920dd954 req-23aeee7b-f80e-454f-b7df-b2d3ebcc07ad tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 210 time: 0.0652862
May 25 16:37:53.127765 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fdc38fb-e001-4068-bb52-7564c11d0746 req-f66769fb-a5a2-4191-a548-f99346e6d65e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:53.129797 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5fdc38fb-e001-4068-bb52-7564c11d0746 req-f66769fb-a5a2-4191-a548-f99346e6d65e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 943 time: 0.1069548
May 25 16:37:53.178851 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5fdc38fb-e001-4068-bb52-7564c11d0746 req-59ccc3a1-87ea-41fc-92de-bf2c42d06b17 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431764
May 25 16:37:53.699644 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8b0a9da6-6449-49f3-935f-49013e947326 req-33a9bf6c-2686-4b6d-9dcb-291a5e0e1e64 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 210 time: 0.0656505
May 25 16:37:54.038307 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715eae52-8dc1-4a0d-8715-0eb128cabd58 req-f7720808-5063-4c22-b546-4b606ec5bd94 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:54.042557 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-715eae52-8dc1-4a0d-8715-0eb128cabd58 req-f7720808-5063-4c22-b546-4b606ec5bd94 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 944 time: 0.0867560
May 25 16:37:54.133976 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.76', 57620) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:54.140284 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Request body: {'port': {'device_id': 'cb30f9c9-3f47-4ce1-afd8-5adc008a649a', 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02', 'admin_state_up': True, 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:54.172809 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-715eae52-8dc1-4a0d-8715-0eb128cabd58 req-cc6def0f-3230-42d9-b4f6-77d115f0aed2 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1236136
May 25 16:37:54.395392 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-a65cd2ff-c5eb-4b9a-8f9d-4191fc435a64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:54.397004 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-a65cd2ff-c5eb-4b9a-8f9d-4191fc435a64 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=5d60da5ade5b4981948179f148ef1f56&device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 1097 time: 0.2985489
May 25 16:37:54.491096 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-73213796-a57b-4c93-b2a6-bbfd0d6ee778 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d6963172-fb53-4ee4-95ea-1609b9d40db4 HTTP/1.1" status: 200  len: 217 time: 0.0848703
May 25 16:37:54.511734 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0283baa9-6c7e-4928-aab9-21ed141a929e req-67f7de7d-36e0-4494-b03d-5ab8d34aaa24 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 210 time: 0.3331323
May 25 16:37:54.589909 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-6f63573c-dc96-4056-b4e2-5c0a4f515a62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:54.591342 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-6f63573c-dc96-4056-b4e2-5c0a4f515a62 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=b953f31d-4490-4000-b4a7-9a7cdcd546da HTTP/1.1" status: 200  len: 851 time: 0.0929697
May 25 16:37:54.598261 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-33678bbe-18ec-4203-a531-818826a55d6b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:54.599579 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-33678bbe-18ec-4203-a531-818826a55d6b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.76 "GET /v2.0/networks?id=ce683266-622a-4b13-a610-301441bf2882 HTTP/1.1" status: 200  len: 811 time: 0.4553556
May 25 16:37:54.644164 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:54.660170 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Usage tracker for resource:port and tenant:fe57668427364ea7acb08a0f7f2826ed is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:54.669422 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:54.686307 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:54.690624 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c05fd76-f15a-4538-8db5-95d35561e101 req-a78aa4ad-5b32-49e1-80c6-6d71877f64f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:54.694170 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-a6fa6730-c137-41e0-9bbb-67205daf4b93 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=48fa5bbf-9d42-4b66-8b53-a15b499d3d14&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0936460
May 25 16:37:54.699921 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c05fd76-f15a-4538-8db5-95d35561e101 req-a78aa4ad-5b32-49e1-80c6-6d71877f64f3 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fe57668427364ea7acb08a0f7f2826ed&device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 1097 time: 0.5230393
May 25 16:37:54.714368 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c28f5205-807b-4a6e-9098-78dbc00bce89 req-31831d60-6065-4c78-90d0-e9df3b9877e3 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6075809
May 25 16:37:54.730395 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8465e34-586c-4021-83ef-b87dbb86d600 req-dbf14394-0395-46fb-9924-43c34e7f59fa tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:54.739622 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b8465e34-586c-4021-83ef-b87dbb86d600 req-dbf14394-0395-46fb-9924-43c34e7f59fa tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 943 time: 0.3092313
May 25 16:37:54.783395 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-45a5d991-3e7f-49e0-a420-a5840477913a tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Synchronizing usage tracker for tenant:63f896ab0d7e44158204551033c33ba4 on resource:security_group {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:37:54.993444 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-45a5d991-3e7f-49e0-a420-a5840477913a tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Unset dirty status for tenant:63f896ab0d7e44158204551033c33ba4 on resource:security_group {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:37:54.995945 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-45a5d991-3e7f-49e0-a420-a5840477913a tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=63f896ab0d7e44158204551033c33ba4 HTTP/1.1" status: 200  len: 380 time: 0.3525765
May 25 16:37:55.007923 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Request body: {'port': {'device_id': 'ef73ba0e-8188-4e52-b28a-c1e8e3967a4f', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'admin_state_up': True, 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'security_groups': ['b257116c-be87-401f-9cd7-142eb1c0353f']}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:55.019140 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Made reservation on behalf of fe57668427364ea7acb08a0f7f2826ed for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:55.023006 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:55.167023 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-8b42bc19-d495-44ab-99ce-71edc81a016e service neutron] 10.222.0.76 "GET /v2.0/networks/48fa5bbf-9d42-4b66-8b53-a15b499d3d14?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4586661
May 25 16:37:55.226766 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b9bbf13f-40f2-43ea-ae8c-204e12801e9c req-b7ca7b7d-2576-43b2-9eda-1f4f4cbda360 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 210 time: 0.1102402
May 25 16:37:55.289224 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b8465e34-586c-4021-83ef-b87dbb86d600 req-b8a0366d-34e9-4d3d-acac-c7f41bd4a212 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5456269
May 25 16:37:55.378113 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-780be6db-fac6-40bb-bc9f-3c5b9a2e2494 service neutron] 10.222.0.76 "GET /v2.0/networks/48fa5bbf-9d42-4b66-8b53-a15b499d3d14?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2041264
May 25 16:37:55.393842 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:55.420314 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:55.431937 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Made reservation on behalf of 63f896ab0d7e44158204551033c33ba4 for: {'port': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:37:55.437068 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:55.485156 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92e977de-e71b-44e2-8951-cf6f3418245c req-c7bcd5df-2e24-4860-94dc-760f36a8930e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:55.486764 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92e977de-e71b-44e2-8951-cf6f3418245c req-c7bcd5df-2e24-4860-94dc-760f36a8930e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=2441ab18acee4d4c9e276ba69a458348&device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 1096 time: 0.6878302
May 25 16:37:55.487766 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c05fd76-f15a-4538-8db5-95d35561e101 req-73bf150e-783b-4f51-b5ad-01e0e737a861 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:55.489110 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c05fd76-f15a-4538-8db5-95d35561e101 req-73bf150e-783b-4f51-b5ad-01e0e737a861 service neutron] 10.222.0.76 "GET /v2.0/networks?tenant_id=fe57668427364ea7acb08a0f7f2826ed&shared=False HTTP/1.1" status: 200  len: 918 time: 0.7733219
May 25 16:37:55.714396 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Allocated IP 172.20.0.3 (ce683266-622a-4b13-a610-301441bf2882/06161ba6-62a3-443f-9cfb-bccf3f60ad9c/2b1a8c74-03d6-4f98-a405-94fc04b50dd4) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:37:55.923794 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4915b7bc-1d33-40a8-8da3-ee8cec73629e req-544f5b9d-a58d-459f-89e9-3fb974a145e0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 210 time: 0.1007650
May 25 16:37:55.976533 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Allocated IP 172.20.0.6 (1186d694-166f-4246-b68b-e7ce60cb0f02/5e6146eb-31ff-437b-a594-8ddb1d63042e/7ed91548-e01f-419a-904f-ecf099335405) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:37:56.019197 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:56.026834 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92e977de-e71b-44e2-8951-cf6f3418245c req-1e987b58-cf79-415e-ac17-fd7de8129d60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:56.028272 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92e977de-e71b-44e2-8951-cf6f3418245c req-1e987b58-cf79-415e-ac17-fd7de8129d60 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 200  len: 915 time: 0.4830456
May 25 16:37:56.039684 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c79c983-a96a-49ba-8dba-d0fc4694739b req-d4614faa-00bd-48f0-ae0c-9338df3bb8cf tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:56.040353 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Transition to ACTIVE for port object 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 will not be triggered until provisioned by entity DHCP. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:37:56.041817 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4c79c983-a96a-49ba-8dba-d0fc4694739b req-d4614faa-00bd-48f0-ae0c-9338df3bb8cf tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 944 time: 0.5666981
May 25 16:37:56.072478 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:56.095073 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:56.112033 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c05fd76-f15a-4538-8db5-95d35561e101 req-cf942622-ee03-4d71-b629-1e3bc9200e6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:56.113719 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c05fd76-f15a-4538-8db5-95d35561e101 req-cf942622-ee03-4d71-b629-1e3bc9200e6e service neutron] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.5436375
May 25 16:37:56.126335 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92e977de-e71b-44e2-8951-cf6f3418245c req-03dd4ccb-8361-4ca1-acdc-0820e531c50c service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=39034fee-da76-49d9-a359-2be89ce60575 HTTP/1.1" status: 200  len: 217 time: 0.0834134
May 25 16:37:56.187423 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Network ce683266-622a-4b13-a610-301441bf2882 is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:37:56.203846 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:56.222965 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:37:56.326606 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event updated for resources: {'Port': ['ID=2b1a8c74-03d6-4f98-a405-94fc04b50dd4,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:56.346190 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.251s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:56.415876 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:56.418752 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:56.480824 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4770145
May 25 16:37:56.512755 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Request body: {'port': {'device_id': 'ef73ba0e-8188-4e52-b28a-c1e8e3967a4f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:56.567455 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:56.591874 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4c79c983-a96a-49ba-8dba-d0fc4694739b req-31c745f0-e9a1-4603-a364-88474755f0c5 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4862556
May 25 16:37:56.598683 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92e977de-e71b-44e2-8951-cf6f3418245c req-15caf805-f2b4-4165-a26a-65dc9f1a45b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:56.606077 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92e977de-e71b-44e2-8951-cf6f3418245c req-15caf805-f2b4-4165-a26a-65dc9f1a45b1 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c4c2aef1-f957-410f-9038-a1d13568aa6e HTTP/1.1" status: 200  len: 854 time: 0.4600801
May 25 16:37:56.645357 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-67e0e5b4-b800-42ff-ba28-b1062529c5e7 None None] Provisioning for port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:37:56.677435 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-67e0e5b4-b800-42ff-ba28-b1062529c5e7 None None] Provisioning complete for port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:37:56.678176 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-67e0e5b4-b800-42ff-ba28-b1062529c5e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:56.707125 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92e977de-e71b-44e2-8951-cf6f3418245c req-f80fa87e-2940-445e-b143-50c9c303ba92 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e55be10d-206c-4bb4-8273-c9b859b11a42&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0942936
May 25 16:37:56.785853 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:56.818297 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-67e0e5b4-b800-42ff-ba28-b1062529c5e7 None None] Port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:37:57.085493 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 39034fee-da76-49d9-a359-2be89ce60575 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:37:57.105804 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:57.112243 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-2126a81d-a142-479b-ae2f-f541615f79a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:57.115171 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-2126a81d-a142-479b-ae2f-f541615f79a3 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fe57668427364ea7acb08a0f7f2826ed&device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 1097 time: 0.9166551
May 25 16:37:57.196872 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:57.330136 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-c5557f48-ee06-4bfe-bb1a-fcfdc636fbea service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d HTTP/1.1" status: 200  len: 217 time: 0.2041326
May 25 16:37:57.338776 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92e977de-e71b-44e2-8951-cf6f3418245c req-a5938a0d-4cb0-4a29-ab6f-3aa385acb169 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5842452
May 25 16:37:57.339419 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Pushing event updated for resources: {'Port': ['ID=7ed91548-e01f-419a-904f-ecf099335405,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:57.343071 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:57.351453 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 39034fee-da76-49d9-a359-2be89ce60575, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=39034fee-da76-49d9-a359-2be89ce60575,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:37:57.357122 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e09954a-1cdc-4972-956d-1287da7d1863 req-2ecfed25-2d65-47e9-a2d2-6cf67a59caea tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:57.365091 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4e09954a-1cdc-4972-956d-1287da7d1863 req-2ecfed25-2d65-47e9-a2d2-6cf67a59caea tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 931 time: 0.7693892
May 25 16:37:57.382586 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '39034fee-da76-49d9-a359-2be89ce60575', 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42', 'port_id': '39034fee-da76-49d9-a359-2be89ce60575', 'mac_address': 'fa:16:3e:42:f0:91', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 410, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c4c2aef1-f957-410f-9038-a1d13568aa6e', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:37:57.419782 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Network 1186d694-166f-4246-b68b-e7ce60cb0f02 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:37:57.443270 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:37:57.453767 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6e8df4-07b0-4265-ad4f-f761040a5e69 req-21eb3696-bde9-4f61-b2a2-7be79eaa864e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:57.461121 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-df6e8df4-07b0-4265-ad4f-f761040a5e69 req-21eb3696-bde9-4f61-b2a2-7be79eaa864e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 943 time: 0.6967015
May 25 16:37:57.474136 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:37:57.479477 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:57.480113 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:57.482947 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:57.501543 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 {{(pid=92012) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:37:57.510769 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 39034fee-da76-49d9-a359-2be89ce60575 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:37:57.518065 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:57.543964 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 39034fee-da76-49d9-a359-2be89ce60575, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=39034fee-da76-49d9-a359-2be89ce60575,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:37:57.550272 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Transition to ACTIVE for port object 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 will not be triggered until provisioned by entity L2. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:37:57.551243 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:57.562760 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device d6963172-fb53-4ee4-95ea-1609b9d40db4 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:37:57.564640 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-0d96bae7-f075-497a-bc88-6c125e46ad32 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:57.569068 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:57.586216 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-54c4e9c6-957d-4c5d-a583-0cb09e81de31 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:57.709310 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4e09954a-1cdc-4972-956d-1287da7d1863 req-67e254bb-c472-4a2a-8ace-3a543bb3b6ac tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3353133
May 25 16:37:57.709421 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 3.5995090
May 25 16:37:57.715300 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-09e1fa5d-445f-4da0-8518-18d459991bc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:57.716784 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-09e1fa5d-445f-4da0-8518-18d459991bc1 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5e6146eb-31ff-437b-a594-8ddb1d63042e HTTP/1.1" status: 200  len: 857 time: 0.3684902
May 25 16:37:57.744939 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-df6e8df4-07b0-4265-ad4f-f761040a5e69 req-ba189999-7e25-47d6-8844-a4d855f3a6d0 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2827592
May 25 16:37:57.748948 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Request body: {'port': {'device_id': 'cb30f9c9-3f47-4ce1-afd8-5adc008a649a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:37:57.828794 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=39034fee-da76-49d9-a359-2be89ce60575,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:57.852818 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.288s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:57.971327 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port d6963172-fb53-4ee4-95ea-1609b9d40db4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d6963172-fb53-4ee4-95ea-1609b9d40db4,segment=NetworkSegment(b1e2e8a0-c79b-42fe-a4d3-171a8ed15717),segment_id=b1e2e8a0-c79b-42fe-a4d3-171a8ed15717)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:37:57.975955 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-22736f4f-5d4c-4b17-8a7c-9e692decc2b9 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=1186d694-166f-4246-b68b-e7ce60cb0f02&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1559005
May 25 16:37:57.999240 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': 'd6963172-fb53-4ee4-95ea-1609b9d40db4', 'network_id': '48fa5bbf-9d42-4b66-8b53-a15b499d3d14', 'port_id': 'd6963172-fb53-4ee4-95ea-1609b9d40db4', 'mac_address': 'fa:16:3e:71:e4:25', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 416, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b953f31d-4490-4000-b4a7-9a7cdcd546da', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:37:58.023579 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Pushing event updated for resources: {'Port': ['ID=2b1a8c74-03d6-4f98-a405-94fc04b50dd4,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:58.035260 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.450s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:58.090620 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:58.098464 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Attempting to bind port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:37:58.099027 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Attempting to bind port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'}] {{(pid=92012) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:37:58.099377 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Attempting to bind port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 on network ce683266-622a-4b13-a610-301441bf2882 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:37:58.107318 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 on network ce683266-622a-4b13-a610-301441bf2882 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:37:58.107740 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Attempting to bind port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 on network ce683266-622a-4b13-a610-301441bf2882 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:37:58.115456 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 37, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:37:58.115897 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Checking segment: {'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:37:58.116567 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Bound using segment: {'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'} {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:37:58.117730 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Bound port: 2b1a8c74-03d6-4f98-a405-94fc04b50dd4, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'}}] {{(pid=92012) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:37:58.118199 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:58.120576 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d6963172-fb53-4ee4-95ea-1609b9d40db4 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:37:58.144314 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port d6963172-fb53-4ee4-95ea-1609b9d40db4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d6963172-fb53-4ee4-95ea-1609b9d40db4,segment=NetworkSegment(b1e2e8a0-c79b-42fe-a4d3-171a8ed15717),segment_id=b1e2e8a0-c79b-42fe-a4d3-171a8ed15717)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:37:58.151369 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92e977de-e71b-44e2-8951-cf6f3418245c req-ba89293d-b4f0-4105-af16-eac3ade5f4f1 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.7684665
May 25 16:37:58.152352 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:58.154147 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:58.267394 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=d6963172-fb53-4ee4-95ea-1609b9d40db4,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:58.272513 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:58.350674 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] For port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4, host hv-cinder-78638, cleared binding levels {{(pid=92012) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:37:58.356403 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] For port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=2b1a8c74-03d6-4f98-a405-94fc04b50dd4,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92012) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:37:58.369062 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:58.380126 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:58.414840 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 51584) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:58.448398 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:58.449005 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:58.450383 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-2e503555-8f23-404f-8183-15d6db07095a service neutron] 10.222.0.76 "PUT /v2.0/ports/2b1a8c74-03d6-4f98-a405-94fc04b50dd4 HTTP/1.1" status: 200  len: 1093 time: 1.9527459
May 25 16:37:58.450909 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ef73ba0e-8188-4e52-b28a-c1e8e3967a4f', 'tag': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:37:58.476883 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['39034fee-da76-49d9-a359-2be89ce60575'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:37:58.487673 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Pushing event updated for resources: {'Port': ['ID=2b1a8c74-03d6-4f98-a405-94fc04b50dd4,revision_number=3']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:37:58.492269 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:37:58.549981 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['d6963172-fb53-4ee4-95ea-1609b9d40db4'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:37:58.597778 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:58.630480 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-4bab3bd6-4ac8-47be-ba7d-07b79b12d3ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:58.632011 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-4bab3bd6-4ac8-47be-ba7d-07b79b12d3ee service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=63f896ab0d7e44158204551033c33ba4&device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 1096 time: 0.1127081
May 25 16:37:58.637377 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-e12c5805-1425-45bb-bf26-ece693bc91f0 service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4778535
May 25 16:37:58.680939 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198268a4-8eb8-48eb-b651-40591afbaa2e req-2f57f563-15d7-4de5-b954-92db6a194bc3 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:58.714889 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-198268a4-8eb8-48eb-b651-40591afbaa2e req-2f57f563-15d7-4de5-b954-92db6a194bc3 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 945 time: 0.5423260
May 25 16:37:58.761570 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-c9eee6a9-84ef-483a-8d3a-efe7b1daf76f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2b1a8c74-03d6-4f98-a405-94fc04b50dd4 HTTP/1.1" status: 200  len: 217 time: 0.1149380
May 25 16:37:58.834221 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3562553-09db-4a2e-b7e0-0a3900dbefa5 req-b38bcdea-6a49-4d7d-bceb-7c3d61f5de15 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:58.836218 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-e3562553-09db-4a2e-b7e0-0a3900dbefa5 req-b38bcdea-6a49-4d7d-bceb-7c3d61f5de15 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Synchronizing usage tracker for tenant:fe57668427364ea7acb08a0f7f2826ed on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:37:58.870738 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-5cbc5b01-b3cf-4d6f-a4cd-a484abfc29c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:58.872983 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-5cbc5b01-b3cf-4d6f-a4cd-a484abfc29c4 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=06161ba6-62a3-443f-9cfb-bccf3f60ad9c HTTP/1.1" status: 200  len: 850 time: 0.1042573
May 25 16:37:58.979020 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-8a9f53ee-9ee6-4436-8f2e-866c999350ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:58.980655 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-8a9f53ee-9ee6-4436-8f2e-866c999350ba service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ce683266-622a-4b13-a610-301441bf2882&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1000569
May 25 16:37:58.997462 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-80005609-d56e-491e-b7f5-a0afdf13b0e5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:59.082260 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-198268a4-8eb8-48eb-b651-40591afbaa2e req-77991666-eb60-46e6-a99d-e69137cbfc52 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3629024
May 25 16:37:59.083717 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-80005609-d56e-491e-b7f5-a0afdf13b0e5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:59.106587 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-e3562553-09db-4a2e-b7e0-0a3900dbefa5 req-b38bcdea-6a49-4d7d-bceb-7c3d61f5de15 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Unset dirty status for tenant:fe57668427364ea7acb08a0f7f2826ed on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:37:59.108090 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e3562553-09db-4a2e-b7e0-0a3900dbefa5 req-b38bcdea-6a49-4d7d-bceb-7c3d61f5de15 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 931 time: 1.1305625
May 25 16:37:59.208598 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51620) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:37:59.216183 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-80005609-d56e-491e-b7f5-a0afdf13b0e5 admin admin] Usage tracker for resource:security_group_rule and tenant:f1a37c95e0594ce5a8ac42e26aad5b7e is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:59.230042 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-4b77130c-b1bd-4031-8676-b03195c062d6 service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2401726
May 25 16:37:59.264889 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-80005609-d56e-491e-b7f5-a0afdf13b0e5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:59.306799 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3234a578-9e8c-4b55-ac05-d6a2529622fa req-9e3a452d-93b0-4975-92cb-ba224d634777 service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6578507
May 25 16:37:59.333710 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e3562553-09db-4a2e-b7e0-0a3900dbefa5 req-35cb321b-18ca-49a8-986a-d03ed8312c9d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0595613
May 25 16:37:59.334647 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-80005609-d56e-491e-b7f5-a0afdf13b0e5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:59.383357 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ef73ba0e-8188-4e52-b28a-c1e8e3967a4f', 'tag': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4', 'status': 'completed', 'code': 200}
May 25 16:37:59.505760 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-9c2807da-9a99-48ad-9a05-a6e193c14539 req-31099151-7a5d-4bec-82e2-79ebec2351e3 service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2676594
May 25 16:37:59.506763 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-81934e9c-c726-4281-ab7d-680710c78b1e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:59.540371 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-81934e9c-c726-4281-ab7d-680710c78b1e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:37:59.558148 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-81934e9c-c726-4281-ab7d-680710c78b1e admin admin] Usage tracker for resource:security_group_rule and tenant:caa20d38cb8c48b298f71d79943ab131 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:37:59.561831 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-81934e9c-c726-4281-ab7d-680710c78b1e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:37:59.568515 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-81934e9c-c726-4281-ab7d-680710c78b1e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:37:59.751387 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61009b36-2fc2-42bc-a48a-99e378587ef4 req-84fda0e7-c0db-4a88-8bf0-e341e08f4d9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:59.753819 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-61009b36-2fc2-42bc-a48a-99e378587ef4 req-84fda0e7-c0db-4a88-8bf0-e341e08f4d9f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=63f896ab0d7e44158204551033c33ba4&device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 1096 time: 0.1822212
May 25 16:37:59.786341 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-80005609-d56e-491e-b7f5-a0afdf13b0e5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:59.802373 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-80005609-d56e-491e-b7f5-a0afdf13b0e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:59.927562 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-05160eeb-a422-48b0-87fb-22a48abe82b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:37:59.934490 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-81934e9c-c726-4281-ab7d-680710c78b1e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:59.952339 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-81934e9c-c726-4281-ab7d-680710c78b1e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:37:59.956937 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-654f09b9-2c98-4fc0-b1e5-acfc7671e79f req-0ab77d17-09fe-4579-9689-521c0d5bfa72 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:37:59.958564 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-654f09b9-2c98-4fc0-b1e5-acfc7671e79f req-0ab77d17-09fe-4579-9689-521c0d5bfa72 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 943 time: 0.4070501
May 25 16:37:59.972379 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:00.008093 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c9bacc-5645-4888-a6ba-d77030f2841b req-f9efd8fc-2490-4366-88dc-dcd9803080b3 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:00.009707 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e5c9bacc-5645-4888-a6ba-d77030f2841b req-f9efd8fc-2490-4366-88dc-dcd9803080b3 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 944 time: 0.5041423
May 25 16:38:00.052029 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-81934e9c-c726-4281-ab7d-680710c78b1e admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=caa20d38cb8c48b298f71d79943ab131&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8374429
May 25 16:38:00.054925 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51630) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:00.076490 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81934e9c-c726-4281-ab7d-680710c78b1e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5f97880-0cce-4cc7-b757-ad409faf2784,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:00.084887 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-81934e9c-c726-4281-ab7d-680710c78b1e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:00.096979 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61009b36-2fc2-42bc-a48a-99e378587ef4 req-e36288de-5df4-4ba7-8779-8eec4e008552 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:00.099080 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-61009b36-2fc2-42bc-a48a-99e378587ef4 req-e36288de-5df4-4ba7-8779-8eec4e008552 service neutron] 10.222.0.76 "GET /v2.0/networks?id=ce683266-622a-4b13-a610-301441bf2882 HTTP/1.1" status: 200  len: 912 time: 0.3301411
May 25 16:38:00.106795 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-80005609-d56e-491e-b7f5-a0afdf13b0e5 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=f1a37c95e0594ce5a8ac42e26aad5b7e&name=default HTTP/1.1" status: 200  len: 2979 time: 1.6866221
May 25 16:38:00.115148 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 51634) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:00.131677 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80005609-d56e-491e-b7f5-a0afdf13b0e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6576d87-a124-4f0c-962f-8be8d6a5e745,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:00.157494 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7ed91548-e01f-419a-904f-ecf099335405 {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:38:00.164236 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-80005609-d56e-491e-b7f5-a0afdf13b0e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.236s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:00.180735 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:00.198890 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-654f09b9-2c98-4fc0-b1e5-acfc7671e79f req-20b4c07d-3188-40ce-adb4-6471deaf6406 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1801252
May 25 16:38:00.207476 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e5c9bacc-5645-4888-a6ba-d77030f2841b req-15f9e876-4727-48dc-af22-07cca647b9de tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1691735
May 25 16:38:00.224955 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-61009b36-2fc2-42bc-a48a-99e378587ef4 req-e9c6a980-14c0-4bb9-8d0f-6a2556bbdfde service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2b1a8c74-03d6-4f98-a405-94fc04b50dd4 HTTP/1.1" status: 200  len: 217 time: 0.1169770
May 25 16:38:00.238862 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Transition to ACTIVE for port object 7ed91548-e01f-419a-904f-ecf099335405 will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:38:00.244419 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-007cfbea-1209-486f-8d56-36fc25928345 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:00.263249 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fdbf85c8-d6ab-425b-85bc-f6d129374d04 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:00.296558 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fdbf85c8-d6ab-425b-85bc-f6d129374d04 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:00.303376 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:00.313985 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:00.319167 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-007cfbea-1209-486f-8d56-36fc25928345 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:00.382883 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61009b36-2fc2-42bc-a48a-99e378587ef4 req-ff5ea030-cb90-46f9-8728-77b19ffff879 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:00.384578 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-61009b36-2fc2-42bc-a48a-99e378587ef4 req-ff5ea030-cb90-46f9-8728-77b19ffff879 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=06161ba6-62a3-443f-9cfb-bccf3f60ad9c HTTP/1.1" status: 200  len: 850 time: 0.1413538
May 25 16:38:00.485790 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-007cfbea-1209-486f-8d56-36fc25928345 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:00.498457 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:00.530669 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-007cfbea-1209-486f-8d56-36fc25928345 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5f97880-0cce-4cc7-b757-ad409faf2784,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:00.560682 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-007cfbea-1209-486f-8d56-36fc25928345 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:00.562572 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-007cfbea-1209-486f-8d56-36fc25928345 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:00.563731 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-007cfbea-1209-486f-8d56-36fc25928345 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/e5f97880-0cce-4cc7-b757-ad409faf2784 HTTP/1.1" status: 204  len: 168 time: 0.5086262
May 25 16:38:00.597104 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61009b36-2fc2-42bc-a48a-99e378587ef4 req-e3b37201-048f-4986-9541-ddd2879d7395 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:00.600064 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-61009b36-2fc2-42bc-a48a-99e378587ef4 req-e3b37201-048f-4986-9541-ddd2879d7395 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ce683266-622a-4b13-a610-301441bf2882&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2052445
May 25 16:38:00.683666 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Pushing event updated for resources: {'Port': ['ID=7ed91548-e01f-419a-904f-ecf099335405,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:00.698565 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.384s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:00.726685 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Attempting to bind port 7ed91548-e01f-419a-904f-ecf099335405 on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:38:00.727290 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Attempting to bind port 7ed91548-e01f-419a-904f-ecf099335405 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '227f55be-6fbd-4206-b845-6ee4d0737571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:38:00.727815 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Attempting to bind port 7ed91548-e01f-419a-904f-ecf099335405 on network 1186d694-166f-4246-b68b-e7ce60cb0f02 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:38:00.734648 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Port 7ed91548-e01f-419a-904f-ecf099335405 on network 1186d694-166f-4246-b68b-e7ce60cb0f02 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:38:00.735165 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Attempting to bind port 7ed91548-e01f-419a-904f-ecf099335405 on network 1186d694-166f-4246-b68b-e7ce60cb0f02 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:38:00.748669 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fdbf85c8-d6ab-425b-85bc-f6d129374d04 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:00.751702 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 37, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:38:00.752217 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Checking segment: {'id': '227f55be-6fbd-4206-b845-6ee4d0737571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:38:00.752749 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Bound using segment: {'id': '227f55be-6fbd-4206-b845-6ee4d0737571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:38:00.753341 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Bound port: 7ed91548-e01f-419a-904f-ecf099335405, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '227f55be-6fbd-4206-b845-6ee4d0737571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 403, 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:38:00.753954 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:00.778688 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:00.794697 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 51654) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:00.808893 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdbf85c8-d6ab-425b-85bc-f6d129374d04 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6576d87-a124-4f0c-962f-8be8d6a5e745,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:00.845581 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf54de6f-0791-4e5c-98be-432e004130da req-6c62d170-ee52-439b-a4df-b8ded96e319e tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:00.847072 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cf54de6f-0791-4e5c-98be-432e004130da req-6c62d170-ee52-439b-a4df-b8ded96e319e tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 945 time: 0.4964602
May 25 16:38:00.848975 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-fdbf85c8-d6ab-425b-85bc-f6d129374d04 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:00.884244 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fdbf85c8-d6ab-425b-85bc-f6d129374d04 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:00.885671 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-fdbf85c8-d6ab-425b-85bc-f6d129374d04 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/a6576d87-a124-4f0c-962f-8be8d6a5e745 HTTP/1.1" status: 204  len: 168 time: 0.7661569
May 25 16:38:00.894415 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0341ae7-f94b-4ab3-9305-7869a9041f17 req-3db7391c-7628-48fa-a0e9-e6f2e2f0a8dc tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:00.896129 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e0341ae7-f94b-4ab3-9305-7869a9041f17 req-3db7391c-7628-48fa-a0e9-e6f2e2f0a8dc tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 943 time: 0.3541813
May 25 16:38:00.955326 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-61009b36-2fc2-42bc-a48a-99e378587ef4 req-ef67eeba-09e3-4607-8737-dadae27b28cf service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3449135
May 25 16:38:00.997911 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cf54de6f-0791-4e5c-98be-432e004130da req-dc93086a-8009-4ab9-b575-78b28014d2a2 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1391606
May 25 16:38:01.040314 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e0341ae7-f94b-4ab3-9305-7869a9041f17 req-5d0a67e0-ab53-422c-a68e-395ec09e4912 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1334190
May 25 16:38:01.055342 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] For port 7ed91548-e01f-419a-904f-ecf099335405, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:38:01.059136 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] For port 7ed91548-e01f-419a-904f-ecf099335405, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7ed91548-e01f-419a-904f-ecf099335405,segment=NetworkSegment(227f55be-6fbd-4206-b845-6ee4d0737571),segment_id=227f55be-6fbd-4206-b845-6ee4d0737571)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:38:01.071141 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.080847 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:01.090329 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:38:01.128051 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 39034fee-da76-49d9-a359-2be89ce60575 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:38:01.151624 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51666) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:01.193761 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:01.194969 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.196972 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] 10.222.0.76 "PUT /v2.0/ports/7ed91548-e01f-419a-904f-ecf099335405 HTTP/1.1" status: 200  len: 1093 time: 3.4789650
May 25 16:38:01.197915 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cb30f9c9-3f47-4ce1-afd8-5adc008a649a', 'tag': '7ed91548-e01f-419a-904f-ecf099335405'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:38:01.265367 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aa33a34c-efbe-460b-84c4-7a4f630c7001 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.282301 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-61009b36-2fc2-42bc-a48a-99e378587ef4 req-823ee1e4-e339-43c4-88de-b5b203f801ff service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3197184
May 25 16:38:01.285020 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-aa33a34c-efbe-460b-84c4-7a4f630c7001 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:01.291949 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-aa33a34c-efbe-460b-84c4-7a4f630c7001 admin admin] Usage tracker for resource:security_group_rule and tenant:09e2ebe033de4f57bd5afe4ee9212534 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:01.295482 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-aa33a34c-efbe-460b-84c4-7a4f630c7001 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:01.297203 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7678179e-a580-49af-8024-e880bd9a9624 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.302217 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-aa33a34c-efbe-460b-84c4-7a4f630c7001 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:01.378946 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cb30f9c9-3f47-4ce1-afd8-5adc008a649a', 'tag': '7ed91548-e01f-419a-904f-ecf099335405', 'status': 'completed', 'code': 200}
May 25 16:38:01.402430 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-7678179e-a580-49af-8024-e880bd9a9624 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:01.415912 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Pushing event updated for resources: {'Port': ['ID=7ed91548-e01f-419a-904f-ecf099335405,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:01.420403 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-7678179e-a580-49af-8024-e880bd9a9624 admin admin] Usage tracker for resource:security_group_rule and tenant:b7f99ea74bd940a1b7a9765f5f1d4773 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:01.425353 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.345s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:01.426421 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-7678179e-a580-49af-8024-e880bd9a9624 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:01.496058 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-7678179e-a580-49af-8024-e880bd9a9624 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:01.503132 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aa33a34c-efbe-460b-84c4-7a4f630c7001 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.509431 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aa33a34c-efbe-460b-84c4-7a4f630c7001 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.518554 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 39034fee-da76-49d9-a359-2be89ce60575 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:38:01.532998 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 39034fee-da76-49d9-a359-2be89ce60575 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:01.533869 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.535623 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b84c5399-74e0-45a8-8367-70f7d06fe657 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:01.574191 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-14677377-da28-47fc-a378-7189d5bb66fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.595880 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-aa33a34c-efbe-460b-84c4-7a4f630c7001 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=09e2ebe033de4f57bd5afe4ee9212534&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4429855
May 25 16:38:01.599381 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51678) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:01.605350 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa33a34c-efbe-460b-84c4-7a4f630c7001 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae8f5653-b9be-4480-8587-e40fcd48b06b,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:01.635468 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-aa33a34c-efbe-460b-84c4-7a4f630c7001 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:01.652162 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d,segment=NetworkSegment(227f55be-6fbd-4206-b845-6ee4d0737571),segment_id=227f55be-6fbd-4206-b845-6ee4d0737571)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:01.674182 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': 'ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d', 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02', 'port_id': 'ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d', 'mac_address': 'fa:16:3e:c5:91:39', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 403, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5e6146eb-31ff-437b-a594-8ddb1d63042e', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:38:01.675345 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-efaf2cdb-8c40-4057-be03-eb4874c35571 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:01.678195 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-efaf2cdb-8c40-4057-be03-eb4874c35571 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fe57668427364ea7acb08a0f7f2826ed&device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 1096 time: 0.3637877
May 25 16:38:01.696319 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-63591d39-4eae-47ca-86bf-b818f950752e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.728874 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-63591d39-4eae-47ca-86bf-b818f950752e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.738528 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51682) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:01.777303 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-769ef9c8-8458-4355-99eb-fe831e1d83e6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.785250 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.805537 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-5b97e7fc-7b6c-445e-845f-c0ae115f0481 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7ed91548-e01f-419a-904f-ecf099335405 HTTP/1.1" status: 200  len: 217 time: 0.1162841
May 25 16:38:01.806491 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.817736 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-769ef9c8-8458-4355-99eb-fe831e1d83e6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:01.825788 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-769ef9c8-8458-4355-99eb-fe831e1d83e6 admin admin] Usage tracker for resource:security_group_rule and tenant:9700efd5923742e7806a7ed32ed770bc is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:01.829230 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-769ef9c8-8458-4355-99eb-fe831e1d83e6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:01.833738 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:38:01.836353 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-769ef9c8-8458-4355-99eb-fe831e1d83e6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:01.859527 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a7788ff0-f301-463e-8b35-fead9db52a0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39034fee-da76-49d9-a359-2be89ce60575'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:38:01.869647 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-63591d39-4eae-47ca-86bf-b818f950752e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.876780 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-22f0d858-46f1-4415-bf3c-6369fe9b7403 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:01.898943 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63591d39-4eae-47ca-86bf-b818f950752e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae8f5653-b9be-4480-8587-e40fcd48b06b,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:01.907055 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-63591d39-4eae-47ca-86bf-b818f950752e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:01.929589 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-63591d39-4eae-47ca-86bf-b818f950752e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.930863 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-63591d39-4eae-47ca-86bf-b818f950752e admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/ae8f5653-b9be-4480-8587-e40fcd48b06b HTTP/1.1" status: 204  len: 168 time: 0.3302193
May 25 16:38:01.940845 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90f25f10-b298-4ced-8ed0-669dd0c16461 req-dab969b0-d52a-4d44-962c-eef2cfe8e400 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:01.942912 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-90f25f10-b298-4ced-8ed0-669dd0c16461 req-dab969b0-d52a-4d44-962c-eef2cfe8e400 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 943 time: 0.4930000
May 25 16:38:01.961251 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d,segment=NetworkSegment(227f55be-6fbd-4206-b845-6ee4d0737571),segment_id=227f55be-6fbd-4206-b845-6ee4d0737571)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:01.965632 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 39034fee-da76-49d9-a359-2be89ce60575, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=39034fee-da76-49d9-a359-2be89ce60575,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:01.969608 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:01.973036 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:01.988266 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b71166-58c9-445c-bb2c-947eae9453c5 req-9d237513-1e98-4f8a-97bf-32e6e01f5073 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:01.990627 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-44b71166-58c9-445c-bb2c-947eae9453c5 req-9d237513-1e98-4f8a-97bf-32e6e01f5073 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 944 time: 0.4824240
May 25 16:38:02.014162 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.015014 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device d6963172-fb53-4ee4-95ea-1609b9d40db4 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:38:02.015234 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-2617c9f2-f404-4b56-8613-b743313a3208 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:02.017113 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-769ef9c8-8458-4355-99eb-fe831e1d83e6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.018212 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-2617c9f2-f404-4b56-8613-b743313a3208 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5e6146eb-31ff-437b-a594-8ddb1d63042e HTTP/1.1" status: 200  len: 857 time: 0.2023184
May 25 16:38:02.025415 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-769ef9c8-8458-4355-99eb-fe831e1d83e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.039008 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:02.082300 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-769ef9c8-8458-4355-99eb-fe831e1d83e6 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=9700efd5923742e7806a7ed32ed770bc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3426418
May 25 16:38:02.084207 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-769ef9c8-8458-4355-99eb-fe831e1d83e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f686674a-d843-4aa2-879d-367e73543c55,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:02.087430 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51700) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:02.090986 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-769ef9c8-8458-4355-99eb-fe831e1d83e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:02.198277 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-90ad430f-8450-4237-8047-899b624573ee admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.217113 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7678179e-a580-49af-8024-e880bd9a9624 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.224849 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-1487052e-ceca-490f-b847-22edd95da827 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=1186d694-166f-4246-b68b-e7ce60cb0f02&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1978600
May 25 16:38:02.244216 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:38:02.252387 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-90ad430f-8450-4237-8047-899b624573ee admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.265793 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7678179e-a580-49af-8024-e880bd9a9624 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.276677 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-90f25f10-b298-4ced-8ed0-669dd0c16461 req-42e4bba9-cce2-43ee-aab9-fcbeb1a3899a tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3237178
May 25 16:38:02.344675 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-90ad430f-8450-4237-8047-899b624573ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.352825 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:02.373582 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:02.395905 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-44b71166-58c9-445c-bb2c-947eae9453c5 req-73a9f7ef-200d-43a7-a05c-34d5d34b452b tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3840365
May 25 16:38:02.399080 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ad430f-8450-4237-8047-899b624573ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f686674a-d843-4aa2-879d-367e73543c55,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:02.412512 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-90ad430f-8450-4237-8047-899b624573ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:02.430279 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-90ad430f-8450-4237-8047-899b624573ee admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.436413 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-90ad430f-8450-4237-8047-899b624573ee admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/f686674a-d843-4aa2-879d-367e73543c55 HTTP/1.1" status: 204  len: 168 time: 0.3476236
May 25 16:38:02.500304 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:02.568573 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.595s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:02.621490 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7678179e-a580-49af-8024-e880bd9a9624 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4ddfaf7-0d27-450f-96b3-0375147cda06,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:02.626984 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-7678179e-a580-49af-8024-e880bd9a9624 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=b7f99ea74bd940a1b7a9765f5f1d4773&name=default HTTP/1.1" status: 200  len: 2979 time: 1.8293016
May 25 16:38:02.630008 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51716) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:02.633007 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-7678179e-a580-49af-8024-e880bd9a9624 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.260s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:02.647080 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-2eebf93e-b86b-47d3-887c-89f29f48daed None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.546s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:02.787295 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-de33a55d-eb0e-4458-8128-3282e1dfecfc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.831498 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-8a28a3d9-14dc-42e5-be90-3cc36cf5d882 service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5917239
May 25 16:38:02.850390 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-de33a55d-eb0e-4458-8128-3282e1dfecfc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.864419 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=39034fee-da76-49d9-a359-2be89ce60575,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:02.886504 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:02.900325 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port d6963172-fb53-4ee4-95ea-1609b9d40db4 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:38:02.911423 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port d6963172-fb53-4ee4-95ea-1609b9d40db4 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:02.911891 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.943664 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-de33a55d-eb0e-4458-8128-3282e1dfecfc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.950357 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:02.957935 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc752843-e21b-4d2d-8283-82f2c7ddbded req-ad131889-6702-4f25-87e5-03016090b197 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:02.967390 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dc752843-e21b-4d2d-8283-82f2c7ddbded req-ad131889-6702-4f25-87e5-03016090b197 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 945 time: 0.4446938
May 25 16:38:02.967552 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de33a55d-eb0e-4458-8128-3282e1dfecfc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4ddfaf7-0d27-450f-96b3-0375147cda06,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:02.975760 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-de33a55d-eb0e-4458-8128-3282e1dfecfc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:02.977154 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-de33a55d-eb0e-4458-8128-3282e1dfecfc admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:02.981304 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-de33a55d-eb0e-4458-8128-3282e1dfecfc admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/e4ddfaf7-0d27-450f-96b3-0375147cda06 HTTP/1.1" status: 204  len: 168 time: 0.3475144
May 25 16:38:03.051374 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dc752843-e21b-4d2d-8283-82f2c7ddbded req-c56a72a3-3ee1-473d-a6ab-ca02f59144d8 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0817063
May 25 16:38:03.076458 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:03.088825 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:38:03.089022 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34f8bad-febf-4c20-ab15-15c2fab06a7d req-b7437333-a8a7-408f-bbfb-abd0ddb27a1a tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:03.096221 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a34f8bad-febf-4c20-ab15-15c2fab06a7d req-b7437333-a8a7-408f-bbfb-abd0ddb27a1a tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 943 time: 0.4674418
May 25 16:38:03.138360 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port d6963172-fb53-4ee4-95ea-1609b9d40db4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d6963172-fb53-4ee4-95ea-1609b9d40db4,segment=NetworkSegment(b1e2e8a0-c79b-42fe-a4d3-171a8ed15717),segment_id=b1e2e8a0-c79b-42fe-a4d3-171a8ed15717)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:03.155919 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7b27b0e-8b4f-4ce3-ad37-e332b0eb4c79 req-65461efa-5fd0-427b-afc7-5f86980287eb service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3166592
May 25 16:38:03.192653 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:03.194146 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a34f8bad-febf-4c20-ab15-15c2fab06a7d req-73a7a112-2908-40dd-9ef8-a4fe6d779c8d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0968304
May 25 16:38:03.197972 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:03.308390 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9660a016-3cb8-43b0-bdff-fc03d5391ffd req-14556897-24ee-46bf-ba00-4bc8590239c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:03.310963 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9660a016-3cb8-43b0-bdff-fc03d5391ffd req-14556897-24ee-46bf-ba00-4bc8590239c8 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fe57668427364ea7acb08a0f7f2826ed&device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 1096 time: 0.0890932
May 25 16:38:03.322248 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=d6963172-fb53-4ee4-95ea-1609b9d40db4,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:03.325573 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:03.332863 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=2b1a8c74-03d6-4f98-a405-94fc04b50dd4,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:03.347398 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'port_id': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4', 'mac_address': 'fa:16:3e:af:77:19', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 430, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:38:03.404656 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:03.423606 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:38:03.446675 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=2b1a8c74-03d6-4f98-a405-94fc04b50dd4,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:03.462617 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:03.468889 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:03.587175 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9660a016-3cb8-43b0-bdff-fc03d5391ffd req-d5c01f75-c739-4e10-aec4-40f32c6d0984 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:03.588623 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9660a016-3cb8-43b0-bdff-fc03d5391ffd req-d5c01f75-c739-4e10-aec4-40f32c6d0984 service neutron] 10.222.0.76 "GET /v2.0/networks?id=1186d694-166f-4246-b68b-e7ce60cb0f02 HTTP/1.1" status: 200  len: 918 time: 0.2703488
May 25 16:38:03.663778 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a7788ff0-f301-463e-8b35-fead9db52a0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39034fee-da76-49d9-a359-2be89ce60575', 'code': 200}
May 25 16:38:03.729349 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51752) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:03.736880 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9660a016-3cb8-43b0-bdff-fc03d5391ffd req-6468803e-94db-4fd2-8ea8-d3c812c54015 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7ed91548-e01f-419a-904f-ecf099335405 HTTP/1.1" status: 200  len: 217 time: 0.1396656
May 25 16:38:03.748435 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=2b1a8c74-03d6-4f98-a405-94fc04b50dd4,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:03.759487 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.291s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:03.767807 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['2b1a8c74-03d6-4f98-a405-94fc04b50dd4'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:38:03.785256 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-70550259-ec68-42b0-b344-a6d16fe82e65 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:03.821565 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddbee24f-5929-4193-b4bf-9ee6edfb0cd3 req-1e185bad-2fb9-4c59-90f1-dc709c681899 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:03.822803 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ddbee24f-5929-4193-b4bf-9ee6edfb0cd3 req-1e185bad-2fb9-4c59-90f1-dc709c681899 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 944 time: 0.3319609
May 25 16:38:03.828420 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-70550259-ec68-42b0-b344-a6d16fe82e65 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:03.846599 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-70550259-ec68-42b0-b344-a6d16fe82e65 admin admin] Usage tracker for resource:security_group_rule and tenant:778c07b08ee54141be7a1ac506a7c5ba is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:03.859320 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-70550259-ec68-42b0-b344-a6d16fe82e65 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:03.876357 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-70550259-ec68-42b0-b344-a6d16fe82e65 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:03.939650 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9660a016-3cb8-43b0-bdff-fc03d5391ffd req-04f36f2c-490b-4f25-9218-7ffd20b184d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:03.941626 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9660a016-3cb8-43b0-bdff-fc03d5391ffd req-04f36f2c-490b-4f25-9218-7ffd20b184d4 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5e6146eb-31ff-437b-a594-8ddb1d63042e HTTP/1.1" status: 200  len: 857 time: 0.1968846
May 25 16:38:03.963855 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ddbee24f-5929-4193-b4bf-9ee6edfb0cd3 req-446c8396-3e66-4d97-8f53-22871eb6600c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1306520
May 25 16:38:04.000671 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:04.007858 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-70550259-ec68-42b0-b344-a6d16fe82e65 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:04.024403 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a5e56a9-4a7e-41c1-bf22-9141d37940fe req-c4a2214f-48a8-4094-86f0-2c0fde136ca6 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:04.031769 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4a5e56a9-4a7e-41c1-bf22-9141d37940fe req-c4a2214f-48a8-4094-86f0-2c0fde136ca6 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 945 time: 0.3456156
May 25 16:38:04.053502 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-70550259-ec68-42b0-b344-a6d16fe82e65 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:04.058030 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9660a016-3cb8-43b0-bdff-fc03d5391ffd req-3bc81b18-0fb8-4154-97e7-ad3ed174ee69 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=1186d694-166f-4246-b68b-e7ce60cb0f02&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0899680
May 25 16:38:04.073256 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-769ef9c8-8458-4355-99eb-fe831e1d83e6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:04.114395 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70550259-ec68-42b0-b344-a6d16fe82e65 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=528192f0-8c48-4b54-9577-1202e39c3b86,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:04.138359 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-70550259-ec68-42b0-b344-a6d16fe82e65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:04.193094 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-70550259-ec68-42b0-b344-a6d16fe82e65 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=778c07b08ee54141be7a1ac506a7c5ba&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4616754
May 25 16:38:04.197688 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7ad7f862-a930-4a44-ac99-4b666bd82751 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:04.197848 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51770) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:04.200831 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4a5e56a9-4a7e-41c1-bf22-9141d37940fe req-fccd1006-bdc3-4280-be5a-81b94523a3b1 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1677849
May 25 16:38:04.282792 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9d490e-4e4d-4cb1-9bfe-2c7b9078e75a req-3ec31b50-5416-461e-bace-931dcecb8998 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:04.284270 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-3a9d490e-4e4d-4cb1-9bfe-2c7b9078e75a req-3ec31b50-5416-461e-bace-931dcecb8998 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 1098 time: 0.2741389
May 25 16:38:04.315802 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-3a9d490e-4e4d-4cb1-9bfe-2c7b9078e75a req-b78aaaa7-23d7-4018-9771-97a870760ef3 service neutron] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:04.339074 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9660a016-3cb8-43b0-bdff-fc03d5391ffd req-63f3f07a-c4b3-4407-878a-8529eccb2310 service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2745891
May 25 16:38:04.350184 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-3a9d490e-4e4d-4cb1-9bfe-2c7b9078e75a req-b78aaaa7-23d7-4018-9771-97a870760ef3 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:04.358255 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-3a9d490e-4e4d-4cb1-9bfe-2c7b9078e75a req-b78aaaa7-23d7-4018-9771-97a870760ef3 service neutron] Usage tracker for resource:security_group_rule and tenant:42c4dfd6dffb4b048459af4bd9322afe is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:04.361253 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-84893781-13b9-46f6-8331-3140f0d2e6b1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:04.396093 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-84893781-13b9-46f6-8331-3140f0d2e6b1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:04.435282 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 51778) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:04.463564 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-3a9d490e-4e4d-4cb1-9bfe-2c7b9078e75a req-b78aaaa7-23d7-4018-9771-97a870760ef3 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:04.479550 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-3a9d490e-4e4d-4cb1-9bfe-2c7b9078e75a req-b78aaaa7-23d7-4018-9771-97a870760ef3 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:04.482561 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-84893781-13b9-46f6-8331-3140f0d2e6b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:04.491960 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:04.523434 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84893781-13b9-46f6-8331-3140f0d2e6b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=528192f0-8c48-4b54-9577-1202e39c3b86,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:04.525479 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-84893781-13b9-46f6-8331-3140f0d2e6b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:04.542677 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-84893781-13b9-46f6-8331-3140f0d2e6b1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:04.543895 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-84893781-13b9-46f6-8331-3140f0d2e6b1 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/528192f0-8c48-4b54-9577-1202e39c3b86 HTTP/1.1" status: 204  len: 168 time: 0.3450868
May 25 16:38:04.644092 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9660a016-3cb8-43b0-bdff-fc03d5391ffd req-06ba323d-4328-4ae9-867f-05a903382a14 service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2988811
May 25 16:38:04.662886 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-3a9d490e-4e4d-4cb1-9bfe-2c7b9078e75a req-b78aaaa7-23d7-4018-9771-97a870760ef3 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:04.670322 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-3a9d490e-4e4d-4cb1-9bfe-2c7b9078e75a req-b78aaaa7-23d7-4018-9771-97a870760ef3 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:04.675793 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-493ff39c-dc80-4a05-8d80-46b99dd84fd8 req-01fc61c3-a0f1-4c13-bf67-4f5f9f1d9d98 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:04.677322 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-493ff39c-dc80-4a05-8d80-46b99dd84fd8 req-01fc61c3-a0f1-4c13-bf67-4f5f9f1d9d98 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 946 time: 0.2430305
May 25 16:38:04.687631 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-63591d39-4eae-47ca-86bf-b818f950752e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:04.695512 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65732af6-549a-487c-9e58-5ca85e9ed8e5 req-ff5fb604-1e1c-40cc-ad01-659eb360bd77 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:04.707709 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-3a9d490e-4e4d-4cb1-9bfe-2c7b9078e75a req-b78aaaa7-23d7-4018-9771-97a870760ef3 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4119267
May 25 16:38:04.708898 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-65732af6-549a-487c-9e58-5ca85e9ed8e5 req-ff5fb604-1e1c-40cc-ad01-659eb360bd77 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 943 time: 0.2719162
May 25 16:38:04.729375 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b78aaaa7-23d7-4018-9771-97a870760ef3 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=ffab6e4a-b2a2-4667-a3a3-c3f9bcce94a3,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:04.733429 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b78aaaa7-23d7-4018-9771-97a870760ef3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:04.799001 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-65732af6-549a-487c-9e58-5ca85e9ed8e5 req-95d13e9a-d2b1-4c6f-81cc-a7a99d068c79 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0888839
May 25 16:38:04.810002 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-493ff39c-dc80-4a05-8d80-46b99dd84fd8 req-3c0de18c-6b72-4ece-8a57-4dd1c0cfe0f7 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0971584
May 25 16:38:04.928989 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7cc40df3-dbd7-4bf2-9bbc-4f0530d0a942 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:04.946061 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-7cc40df3-dbd7-4bf2-9bbc-4f0530d0a942 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:04.950531 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-7cc40df3-dbd7-4bf2-9bbc-4f0530d0a942 admin admin] Usage tracker for resource:security_group_rule and tenant:ee3b98cf34bc462fa247db46954c00b2 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:04.953917 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-7cc40df3-dbd7-4bf2-9bbc-4f0530d0a942 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:04.961117 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-7cc40df3-dbd7-4bf2-9bbc-4f0530d0a942 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:05.030482 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:05.060134 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7cc40df3-dbd7-4bf2-9bbc-4f0530d0a942 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:05.065054 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7cc40df3-dbd7-4bf2-9bbc-4f0530d0a942 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:05.097067 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:05.105440 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 7ed91548-e01f-419a-904f-ecf099335405 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:38:05.107790 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:38:05.144173 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-7cc40df3-dbd7-4bf2-9bbc-4f0530d0a942 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=ee3b98cf34bc462fa247db46954c00b2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7046542
May 25 16:38:05.144511 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cc40df3-dbd7-4bf2-9bbc-4f0530d0a942 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9404799-19e1-4f87-9069-323f68e5db58,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:05.145319 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51804) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:05.160304 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-7cc40df3-dbd7-4bf2-9bbc-4f0530d0a942 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:05.273467 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:38:05.287696 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-080718e9-9973-47a3-a7a9-11caee4acad9 req-c66e04b3-a0c2-4c72-9264-9b03e4c62de4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:05.291510 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:05.291884 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:05.298267 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c0b9c268-422e-46ac-91a2-bd2416d31bdc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:05.302961 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-080718e9-9973-47a3-a7a9-11caee4acad9 req-c66e04b3-a0c2-4c72-9264-9b03e4c62de4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 944 time: 0.1596537
May 25 16:38:05.353488 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c0b9c268-422e-46ac-91a2-bd2416d31bdc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:05.380183 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 7ed91548-e01f-419a-904f-ecf099335405, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7ed91548-e01f-419a-904f-ecf099335405,segment=NetworkSegment(227f55be-6fbd-4206-b845-6ee4d0737571),segment_id=227f55be-6fbd-4206-b845-6ee4d0737571)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:05.403341 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '7ed91548-e01f-419a-904f-ecf099335405', 'network_id': '1186d694-166f-4246-b68b-e7ce60cb0f02', 'port_id': '7ed91548-e01f-419a-904f-ecf099335405', 'mac_address': 'fa:16:3e:98:93:2e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 403, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5e6146eb-31ff-437b-a594-8ddb1d63042e', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:38:05.459309 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c0b9c268-422e-46ac-91a2-bd2416d31bdc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:05.465790 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-080718e9-9973-47a3-a7a9-11caee4acad9 req-577c8aa3-4065-40d8-861b-28e2f4bc6aee tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1594369
May 25 16:38:05.466538 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-de33a55d-eb0e-4458-8128-3282e1dfecfc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:05.502714 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b9c268-422e-46ac-91a2-bd2416d31bdc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9404799-19e1-4f87-9069-323f68e5db58,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:05.508676 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c0b9c268-422e-46ac-91a2-bd2416d31bdc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:05.510565 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c0b9c268-422e-46ac-91a2-bd2416d31bdc admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:05.515012 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911927f8-fb9a-4fee-8e06-60b41397e0c1 req-5521c927-6607-49ad-8db6-97b80d5379ed tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:05.515526 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c0b9c268-422e-46ac-91a2-bd2416d31bdc admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/c9404799-19e1-4f87-9069-323f68e5db58 HTTP/1.1" status: 204  len: 168 time: 0.3687668
May 25 16:38:05.519256 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-911927f8-fb9a-4fee-8e06-60b41397e0c1 req-5521c927-6607-49ad-8db6-97b80d5379ed tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 945 time: 0.1760337
May 25 16:38:05.529090 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:05.552615 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:05.588828 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=2b1a8c74-03d6-4f98-a405-94fc04b50dd4,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:05.591316 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7ed91548-e01f-419a-904f-ecf099335405 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:38:05.597153 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:05.598094 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:38:05.621219 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-911927f8-fb9a-4fee-8e06-60b41397e0c1 req-cea87b71-f67a-4a47-ac05-931ad9a3c5b6 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0940030
May 25 16:38:05.631495 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:05.677982 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '202b7b00-4b4f-4282-b5ca-6e5f51a3a967', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd6963172-fb53-4ee4-95ea-1609b9d40db4'}, {'server_uuid': 'ef73ba0e-8188-4e52-b28a-c1e8e3967a4f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:38:05.717339 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 7ed91548-e01f-419a-904f-ecf099335405, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7ed91548-e01f-419a-904f-ecf099335405,segment=NetworkSegment(227f55be-6fbd-4206-b845-6ee4d0737571),segment_id=227f55be-6fbd-4206-b845-6ee4d0737571)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:05.728787 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:05.746645 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=2b1a8c74-03d6-4f98-a405-94fc04b50dd4,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:05.750465 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:05.750952 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.016s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:05.803423 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '202b7b00-4b4f-4282-b5ca-6e5f51a3a967', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd6963172-fb53-4ee4-95ea-1609b9d40db4', 'code': 200}
May 25 16:38:05.803714 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ef73ba0e-8188-4e52-b28a-c1e8e3967a4f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4', 'code': 200}
May 25 16:38:05.868477 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:38:05.898023 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:05.899062 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:05.959370 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=7ed91548-e01f-419a-904f-ecf099335405,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:05.963330 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:06.097780 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a9ee9d3-e4c7-4e00-ba78-bd9a680e37ae req-d28f8949-bac5-4a80-8b75-7f87342d9cd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:06.100149 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-2a9ee9d3-e4c7-4e00-ba78-bd9a680e37ae req-d28f8949-bac5-4a80-8b75-7f87342d9cd2 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 1098 time: 0.1192727
May 25 16:38:06.113211 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['7ed91548-e01f-419a-904f-ecf099335405'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:38:06.159164 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-2a9ee9d3-e4c7-4e00-ba78-bd9a680e37ae req-ac695ca3-f2a5-4ef6-9ff8-84076f818b34 service neutron] Synchronizing usage tracker for tenant:42c4dfd6dffb4b048459af4bd9322afe on resource:security_group {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:38:06.191794 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-2a9ee9d3-e4c7-4e00-ba78-bd9a680e37ae req-ac695ca3-f2a5-4ef6-9ff8-84076f818b34 service neutron] Unset dirty status for tenant:42c4dfd6dffb4b048459af4bd9322afe on resource:security_group {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:38:06.195538 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-2a9ee9d3-e4c7-4e00-ba78-bd9a680e37ae req-ac695ca3-f2a5-4ef6-9ff8-84076f818b34 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0879941
May 25 16:38:06.303383 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:06.423618 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10ce930d-5ab8-4d8b-8d23-db10f2330fc4 req-ca14bc87-17e5-4bd2-9809-6b0fb3bf4ac1 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:06.425109 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-10ce930d-5ab8-4d8b-8d23-db10f2330fc4 req-ca14bc87-17e5-4bd2-9809-6b0fb3bf4ac1 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 944 time: 0.1934776
May 25 16:38:06.429674 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6da2bce9-e52d-42a2-9a76-8c04e4a501c0 req-a2e8a4e6-2e17-4f26-8c71-b0eb2ab623b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:06.431149 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6da2bce9-e52d-42a2-9a76-8c04e4a501c0 req-a2e8a4e6-2e17-4f26-8c71-b0eb2ab623b9 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 1099 time: 0.2010105
May 25 16:38:06.438732 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d020cd0a-fdc2-41f9-a151-f94c0efec6a5 req-01916ab1-684c-4fa6-8cc7-249d04231d50 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:06.440312 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d020cd0a-fdc2-41f9-a151-f94c0efec6a5 req-01916ab1-684c-4fa6-8cc7-249d04231d50 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 946 time: 0.3653784
May 25 16:38:06.476886 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d,segment=NetworkSegment(227f55be-6fbd-4206-b845-6ee4d0737571),segment_id=227f55be-6fbd-4206-b845-6ee4d0737571)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:06.500190 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:06.500190 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:06.562047 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-10ce930d-5ab8-4d8b-8d23-db10f2330fc4 req-d5420639-0942-45fc-a9f8-81dc58850318 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1207197
May 25 16:38:06.586231 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d020cd0a-fdc2-41f9-a151-f94c0efec6a5 req-057c3b4f-ba17-48fd-bd2f-864ed66eb797 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1010928
May 25 16:38:06.588022 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6da2bce9-e52d-42a2-9a76-8c04e4a501c0 req-4b354632-d150-40a1-83d0-00c5b44acb7a service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1449733
May 25 16:38:06.636192 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:06.655907 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:06.667456 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:06.774555 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed760d5-2c54-441e-8768-778986098050 req-23d0f9aa-e0a1-42ec-adcc-50ea49913674 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:06.779940 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3ed760d5-2c54-441e-8768-778986098050 req-23d0f9aa-e0a1-42ec-adcc-50ea49913674 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0958040
May 25 16:38:06.879240 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3ed760d5-2c54-441e-8768-778986098050 req-fb6d34e8-76ce-4a62-808f-3fcd44d3a32a tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0971341
May 25 16:38:06.909160 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-480511c8-b862-4a6d-8e63-9aa0eb37aa4e req-1d2c8314-5a9e-40b2-ae74-ff87d70f7072 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:06.911093 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-480511c8-b862-4a6d-8e63-9aa0eb37aa4e req-1d2c8314-5a9e-40b2-ae74-ff87d70f7072 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 945 time: 0.1302354
May 25 16:38:06.974517 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-480511c8-b862-4a6d-8e63-9aa0eb37aa4e req-2e7ce87a-93ea-4b1b-ba35-98ab2e65b3a5 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0568714
May 25 16:38:07.806036 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f035b9c-0d0a-439e-80aa-646a77153848', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:38:07.964765 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38488872-843b-4011-817d-f02e8e5e5a40 req-110c14af-a13b-43fc-8c62-a917841f643c tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:07.966213 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-38488872-843b-4011-817d-f02e8e5e5a40 req-110c14af-a13b-43fc-8c62-a917841f643c tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 946 time: 0.1551445
May 25 16:38:08.020468 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-38488872-843b-4011-817d-f02e8e5e5a40 req-d17d7cbb-70bb-41ac-bb11-3f00c26136bf tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0478120
May 25 16:38:08.043031 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ecdc5db-e54a-459b-a1c6-04eadfb12404 req-fa8a6f4c-0853-4cb7-a538-e6b45ca31644 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:08.045057 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8ecdc5db-e54a-459b-a1c6-04eadfb12404 req-fa8a6f4c-0853-4cb7-a538-e6b45ca31644 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 944 time: 0.2323115
May 25 16:38:08.120605 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8ecdc5db-e54a-459b-a1c6-04eadfb12404 req-698243c2-83a5-4d6a-b40e-7576b4672e86 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0618706
May 25 16:38:08.186613 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9f035b9c-0d0a-439e-80aa-646a77153848', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d', 'code': 200}
May 25 16:38:08.494527 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78266f72-2d37-4219-b2eb-715df1d49abd req-e39d1100-ba39-4b52-9744-a36603b9020c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:08.496683 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-78266f72-2d37-4219-b2eb-715df1d49abd req-e39d1100-ba39-4b52-9744-a36603b9020c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1584003
May 25 16:38:08.617755 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-78266f72-2d37-4219-b2eb-715df1d49abd req-b087efb2-e3e4-4354-956a-13639676287d tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1139042
May 25 16:38:08.644358 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdeee223-d31a-42dc-aecd-ec1746c79da1 req-35711b57-c1ac-4f33-8253-25039c8e7f54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:08.646018 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cdeee223-d31a-42dc-aecd-ec1746c79da1 req-35711b57-c1ac-4f33-8253-25039c8e7f54 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 1099 time: 0.1204627
May 25 16:38:08.705003 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cdeee223-d31a-42dc-aecd-ec1746c79da1 req-ac92e794-f72f-43c8-aebe-94bacdf08676 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0519791
May 25 16:38:08.865367 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ce29da-2dd3-4b11-974a-f667ea123d76 req-886c3fd2-ea71-476a-b8d7-028b07267136 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:08.875966 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 51966) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:08.883778 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-d8de0b50-ceb1-476f-80ac-2582fc0af62b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Request body: {'floatingip': {'port_id': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:08.888194 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-15ce29da-2dd3-4b11-974a-f667ea123d76 req-886c3fd2-ea71-476a-b8d7-028b07267136 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1298726
May 25 16:38:09.072944 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8de0b50-ceb1-476f-80ac-2582fc0af62b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:09.136484 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 7ed91548-e01f-419a-904f-ecf099335405 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:38:09.292829 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 7ed91548-e01f-419a-904f-ecf099335405 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:38:09.303519 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 7ed91548-e01f-419a-904f-ecf099335405 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:09.304482 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:09.428095 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52002) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:09.501224 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:09.546535 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 7ed91548-e01f-419a-904f-ecf099335405, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7ed91548-e01f-419a-904f-ecf099335405,segment=NetworkSegment(227f55be-6fbd-4206-b845-6ee4d0737571),segment_id=227f55be-6fbd-4206-b845-6ee4d0737571)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:09.551887 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:09.555355 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:09.652179 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=7ed91548-e01f-419a-904f-ecf099335405,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:09.655371 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:09.747978 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c0ab70-bfba-4442-b0e2-28a767df81e8 req-c3d4f9e4-7fca-4df2-b37d-103f8f6afd5b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:09.753882 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b8c0ab70-bfba-4442-b0e2-28a767df81e8 req-c3d4f9e4-7fca-4df2-b37d-103f8f6afd5b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1750128
May 25 16:38:09.823739 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fe4af097-7970-48c1-a65e-57e0c3d3e0fb admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:09.860508 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-fe4af097-7970-48c1-a65e-57e0c3d3e0fb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:09.875498 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b8c0ab70-bfba-4442-b0e2-28a767df81e8 req-68c69cc3-54ba-48a1-9372-c7e41bde8327 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1161695
May 25 16:38:09.883538 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-fe4af097-7970-48c1-a65e-57e0c3d3e0fb admin admin] Usage tracker for resource:security_group_rule and tenant:0ad6459ead2f4e978a13f389b2cde1d7 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:09.892526 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-fe4af097-7970-48c1-a65e-57e0c3d3e0fb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:09.902290 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-fe4af097-7970-48c1-a65e-57e0c3d3e0fb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:10.019152 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fe4af097-7970-48c1-a65e-57e0c3d3e0fb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:10.024162 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fe4af097-7970-48c1-a65e-57e0c3d3e0fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:10.033950 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:10.077980 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52022) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:10.107995 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-fe4af097-7970-48c1-a65e-57e0c3d3e0fb admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=0ad6459ead2f4e978a13f389b2cde1d7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6774287
May 25 16:38:10.110800 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52028) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:10.130260 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe4af097-7970-48c1-a65e-57e0c3d3e0fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=43c54dd6-4b97-4771-9259-9bfb6e81606c,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:10.139133 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-fe4af097-7970-48c1-a65e-57e0c3d3e0fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:10.188166 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cb30f9c9-3f47-4ce1-afd8-5adc008a649a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ed91548-e01f-419a-904f-ecf099335405'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:38:10.235053 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-86977892-25eb-4277-bd4e-7b11b35a925f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:10.260590 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cb30f9c9-3f47-4ce1-afd8-5adc008a649a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ed91548-e01f-419a-904f-ecf099335405', 'code': 200}
May 25 16:38:10.272597 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-86977892-25eb-4277-bd4e-7b11b35a925f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:10.347720 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e4dc0f34-e71e-4c60-b1be-e0fc3fa88233 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:10.378571 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-e4dc0f34-e71e-4c60-b1be-e0fc3fa88233 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:10.384872 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-e4dc0f34-e71e-4c60-b1be-e0fc3fa88233 admin admin] Usage tracker for resource:security_group_rule and tenant:54ad39aeac6b4f59990fd883513bf046 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:10.389075 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-e4dc0f34-e71e-4c60-b1be-e0fc3fa88233 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:10.393120 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-86977892-25eb-4277-bd4e-7b11b35a925f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:10.408502 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-e4dc0f34-e71e-4c60-b1be-e0fc3fa88233 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:10.410813 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-93675430-b64e-4ef1-977a-bdbcf551e100 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:10.434853 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86977892-25eb-4277-bd4e-7b11b35a925f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=43c54dd6-4b97-4771-9259-9bfb6e81606c,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:10.445684 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-86977892-25eb-4277-bd4e-7b11b35a925f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:10.450218 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8de0b50-ceb1-476f-80ac-2582fc0af62b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:10.466876 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8de0b50-ceb1-476f-80ac-2582fc0af62b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:10.616410 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-86977892-25eb-4277-bd4e-7b11b35a925f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:10.617703 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-86977892-25eb-4277-bd4e-7b11b35a925f admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/43c54dd6-4b97-4771-9259-9bfb6e81606c HTTP/1.1" status: 204  len: 168 time: 0.5054710
May 25 16:38:10.693216 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.l3_db [None req-d8de0b50-ceb1-476f-80ac-2582fc0af62b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Floating IP 80824522-0cb3-4434-95a1-3f1521830e9f associated. External IP: 172.27.3.254, port: 2b1a8c74-03d6-4f98-a405-94fc04b50dd4.
May 25 16:38:10.717802 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-535c11db-8458-48b1-ad29-95719c815d1e req-c2861083-2203-4c5e-a619-e1b0b1ed9bce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:10.720996 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-535c11db-8458-48b1-ad29-95719c815d1e req-c2861083-2203-4c5e-a619-e1b0b1ed9bce service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 1098 time: 0.2613590
May 25 16:38:10.723415 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e4dc0f34-e71e-4c60-b1be-e0fc3fa88233 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:10.744702 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e4dc0f34-e71e-4c60-b1be-e0fc3fa88233 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:10.758347 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-40c3b7d6-6625-4cba-81fb-3e45fd3f7e0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:10.827101 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-535c11db-8458-48b1-ad29-95719c815d1e req-8a6b974a-e577-440e-866a-a4e2fd4d2215 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0982535
May 25 16:38:10.832296 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-e4dc0f34-e71e-4c60-b1be-e0fc3fa88233 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=54ad39aeac6b4f59990fd883513bf046&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7530584
May 25 16:38:10.837154 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52052) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:10.885460 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4dc0f34-e71e-4c60-b1be-e0fc3fa88233 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ef3a408-955b-4fb5-9aee-1ad25d75a0ad,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:10.891854 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-e4dc0f34-e71e-4c60-b1be-e0fc3fa88233 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:10.986874 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bc1461ee-6b16-4ef9-9f1b-5d987a476941 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:11.080381 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bc1461ee-6b16-4ef9-9f1b-5d987a476941 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:11.187171 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:11.289022 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bc1461ee-6b16-4ef9-9f1b-5d987a476941 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:11.299456 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:11.366911 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc1461ee-6b16-4ef9-9f1b-5d987a476941 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ef3a408-955b-4fb5-9aee-1ad25d75a0ad,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:11.370222 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8de0b50-ceb1-476f-80ac-2582fc0af62b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Router d0ffdac8-c8d7-4bac-8f41-858898f1783d has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:38:11.379914 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-bc1461ee-6b16-4ef9-9f1b-5d987a476941 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:11.382440 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bc1461ee-6b16-4ef9-9f1b-5d987a476941 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:11.384105 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-bc1461ee-6b16-4ef9-9f1b-5d987a476941 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/7ef3a408-955b-4fb5-9aee-1ad25d75a0ad HTTP/1.1" status: 204  len: 168 time: 0.5457962
May 25 16:38:11.397712 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b3696e6-5155-4a86-8863-20b517546d00 req-82d4724f-79cd-4159-8c90-2f4eabb8dcb6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:11.399303 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2b3696e6-5155-4a86-8863-20b517546d00 req-82d4724f-79cd-4159-8c90-2f4eabb8dcb6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1972134
May 25 16:38:11.429568 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52076) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:11.452829 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d95e35ab-412b-4391-9280-24615936f40f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:11.490958 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-d95e35ab-412b-4391-9280-24615936f40f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:11.499837 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-d95e35ab-412b-4391-9280-24615936f40f admin admin] Usage tracker for resource:security_group_rule and tenant:0b88f49d1b264537b897a9793c02d373 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:11.505016 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2b3696e6-5155-4a86-8863-20b517546d00 req-92ab36f2-6733-4447-972b-dfa22a1a0b9b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1001048
May 25 16:38:11.505852 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-d95e35ab-412b-4391-9280-24615936f40f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:11.512544 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-d95e35ab-412b-4391-9280-24615936f40f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:11.633153 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8de0b50-ceb1-476f-80ac-2582fc0af62b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:38:11.642869 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8de0b50-ceb1-476f-80ac-2582fc0af62b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:11.649070 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d95e35ab-412b-4391-9280-24615936f40f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:11.655684 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d95e35ab-412b-4391-9280-24615936f40f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:11.656468 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-314baf1a-125a-41ef-a32c-b0ea7f480ba9 None None] Sync routers for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:38:11.670960 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-314baf1a-125a-41ef-a32c-b0ea7f480ba9 None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:38:11.671591 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-314baf1a-125a-41ef-a32c-b0ea7f480ba9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bb10160>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:38:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:11.742152 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-d8de0b50-ceb1-476f-80ac-2582fc0af62b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "PUT /v2.0/floatingips/80824522-0cb3-4434-95a1-3f1521830e9f HTTP/1.1" status: 200  len: 991 time: 2.8649430
May 25 16:38:11.743146 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ef73ba0e-8188-4e52-b28a-c1e8e3967a4f', 'tag': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:38:11.838882 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-80005609-d56e-491e-b7f5-a0afdf13b0e5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:11.870416 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ef73ba0e-8188-4e52-b28a-c1e8e3967a4f', 'tag': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4', 'status': 'completed', 'code': 200}
May 25 16:38:11.907772 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-d95e35ab-412b-4391-9280-24615936f40f admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=0b88f49d1b264537b897a9793c02d373&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4754181
May 25 16:38:11.910677 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52096) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:11.931620 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d95e35ab-412b-4391-9280-24615936f40f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c755028a-9737-44ea-a252-43402b42165e,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:11.940280 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d95e35ab-412b-4391-9280-24615936f40f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:11.985166 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-314baf1a-125a-41ef-a32c-b0ea7f480ba9 None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:38:12.054143 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-50ff79c3-469a-4991-b68b-60f5c3ca97f8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:12.090114 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d88f1a-6ec5-4c56-9b59-3fa25b798db3 req-fa3ed633-b739-4737-99c5-3078a24eb181 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:12.095670 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-63d88f1a-6ec5-4c56-9b59-3fa25b798db3 req-fa3ed633-b739-4737-99c5-3078a24eb181 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=63f896ab0d7e44158204551033c33ba4&device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 1098 time: 0.1045465
May 25 16:38:12.101300 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-50ff79c3-469a-4991-b68b-60f5c3ca97f8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:12.348186 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d88f1a-6ec5-4c56-9b59-3fa25b798db3 req-897c4642-e77d-4b68-9cfb-d43d83a428e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:12.349686 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-63d88f1a-6ec5-4c56-9b59-3fa25b798db3 req-897c4642-e77d-4b68-9cfb-d43d83a428e9 service neutron] 10.222.0.76 "GET /v2.0/networks?id=ce683266-622a-4b13-a610-301441bf2882 HTTP/1.1" status: 200  len: 912 time: 0.2489908
May 25 16:38:12.395449 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-50ff79c3-469a-4991-b68b-60f5c3ca97f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:12.407445 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:12.455211 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-50ff79c3-469a-4991-b68b-60f5c3ca97f8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:12.456907 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-50ff79c3-469a-4991-b68b-60f5c3ca97f8 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/c755028a-9737-44ea-a252-43402b42165e HTTP/1.1" status: 204  len: 168 time: 0.5451264
May 25 16:38:12.457967 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50ff79c3-469a-4991-b68b-60f5c3ca97f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c755028a-9737-44ea-a252-43402b42165e,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:12.480481 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-50ff79c3-469a-4991-b68b-60f5c3ca97f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:12.526728 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-63d88f1a-6ec5-4c56-9b59-3fa25b798db3 req-8551bc48-687a-476e-aef2-76e6e4bae6c6 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2b1a8c74-03d6-4f98-a405-94fc04b50dd4 HTTP/1.1" status: 200  len: 999 time: 0.1651301
May 25 16:38:12.597971 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-314baf1a-125a-41ef-a32c-b0ea7f480ba9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bb10160>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '80824522-0cb3-4434-95a1-3f1521830e9f', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'floating_ip_address': '172.27.3.254', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'port_id': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 104, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'mac_address': 'fa:16:3e:af:77:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ef73ba0e-8188-4e52-b28a-c1e8e3967a4f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:37:42Z', 'updated_at': '2021-05-25T16:38:10Z', 'revision_number': 1, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:41Z', 'revision_number': 5, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:12.618877 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-314baf1a-125a-41ef-a32c-b0ea7f480ba9 None None] Checking router: d0ffdac8-c8d7-4bac-8f41-858898f1783d for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:38:12.638587 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d88f1a-6ec5-4c56-9b59-3fa25b798db3 req-8096079c-0180-4361-ad37-d80e20151d42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:12.640547 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-63d88f1a-6ec5-4c56-9b59-3fa25b798db3 req-8096079c-0180-4361-ad37-d80e20151d42 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=06161ba6-62a3-443f-9cfb-bccf3f60ad9c HTTP/1.1" status: 200  len: 850 time: 0.0994594
May 25 16:38:12.644816 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-314baf1a-125a-41ef-a32c-b0ea7f480ba9 None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:38:12.645826 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-314baf1a-125a-41ef-a32c-b0ea7f480ba9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bb10160>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:38:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:12.891390 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d88f1a-6ec5-4c56-9b59-3fa25b798db3 req-ec4ecfb5-9a1e-47b6-accf-29a8e2cde1af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:12.905622 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-63d88f1a-6ec5-4c56-9b59-3fa25b798db3 req-ec4ecfb5-9a1e-47b6-accf-29a8e2cde1af service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ce683266-622a-4b13-a610-301441bf2882&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2459521
May 25 16:38:12.916512 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-314baf1a-125a-41ef-a32c-b0ea7f480ba9 None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:38:12.996619 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12cadf8d-88bc-4bb3-a7d6-3f057eb0b0ee req-3546a85c-de11-47df-b6f6-6fa290d7c5c7 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:13.008002 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-12cadf8d-88bc-4bb3-a7d6-3f057eb0b0ee req-3546a85c-de11-47df-b6f6-6fa290d7c5c7 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.2976592
May 25 16:38:13.212679 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-12cadf8d-88bc-4bb3-a7d6-3f057eb0b0ee req-17f69f80-d76d-42c0-8430-728795acfc9b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1092312
May 25 16:38:13.291305 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-63d88f1a-6ec5-4c56-9b59-3fa25b798db3 req-d0aa8ade-56ae-4606-b6aa-8fe1ce81fa0d service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3847101
May 25 16:38:13.467556 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-63d88f1a-6ec5-4c56-9b59-3fa25b798db3 req-39c6f7ca-3903-41e8-8a6c-e4e3b789be24 service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1639462
May 25 16:38:13.649180 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-314baf1a-125a-41ef-a32c-b0ea7f480ba9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bb10160>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '80824522-0cb3-4434-95a1-3f1521830e9f', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'floating_ip_address': '172.27.3.254', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'port_id': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 104, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'mac_address': 'fa:16:3e:af:77:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ef73ba0e-8188-4e52-b28a-c1e8e3967a4f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:37:42Z', 'updated_at': '2021-05-25T16:38:10Z', 'revision_number': 1, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:41Z', 'revision_number': 5, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:13.657740 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-314baf1a-125a-41ef-a32c-b0ea7f480ba9 None None] The sync data for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi is: [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '80824522-0cb3-4434-95a1-3f1521830e9f', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'floating_ip_address': '172.27.3.254', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'port_id': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 104, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'mac_address': 'fa:16:3e:af:77:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ef73ba0e-8188-4e52-b28a-c1e8e3967a4f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:37:42Z', 'updated_at': '2021-05-25T16:38:10Z', 'revision_number': 1, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:41Z', 'revision_number': 5, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:38:14.062409 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-236ec32a-317d-4373-9a1c-d4ed10b4c1d1 req-0e555456-6c6d-4521-b55d-bf264d8b7f4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:14.066403 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236ec32a-317d-4373-9a1c-d4ed10b4c1d1 req-0e555456-6c6d-4521-b55d-bf264d8b7f4b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fe57668427364ea7acb08a0f7f2826ed&device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 1098 time: 0.2478578
May 25 16:38:14.077446 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9147afe7-5ce1-4c22-a60f-e7668fbba04d req-ea05a2ec-ace3-464d-a18b-edfe32010fc0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:14.081801 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9147afe7-5ce1-4c22-a60f-e7668fbba04d req-ea05a2ec-ace3-464d-a18b-edfe32010fc0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1763124
May 25 16:38:14.092659 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15642cb3-60e6-464f-af3b-5991b82cd9b5 None None] New status for floating IP 80824522-0cb3-4434-95a1-3f1521830e9f: ACTIVE {{(pid=92014) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:38:14.223768 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9147afe7-5ce1-4c22-a60f-e7668fbba04d req-7915b442-e270-4d82-8ea4-aa5d40c1c8f9 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1164219
May 25 16:38:14.305184 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-236ec32a-317d-4373-9a1c-d4ed10b4c1d1 req-fa34d9f1-a540-462a-9a1d-c3446f2a08b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:14.306592 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236ec32a-317d-4373-9a1c-d4ed10b4c1d1 req-fa34d9f1-a540-462a-9a1d-c3446f2a08b6 service neutron] 10.222.0.76 "GET /v2.0/networks?id=1186d694-166f-4246-b68b-e7ce60cb0f02 HTTP/1.1" status: 200  len: 918 time: 0.2238824
May 25 16:38:14.345739 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52220) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:14.395944 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236ec32a-317d-4373-9a1c-d4ed10b4c1d1 req-f0c24de2-fffe-4d94-80e5-3f811d79552c service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7ed91548-e01f-419a-904f-ecf099335405 HTTP/1.1" status: 200  len: 217 time: 0.0742579
May 25 16:38:14.498151 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-236ec32a-317d-4373-9a1c-d4ed10b4c1d1 req-3ee1e3be-47f7-4475-8381-d8e0bddd6802 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:14.499642 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236ec32a-317d-4373-9a1c-d4ed10b4c1d1 req-3ee1e3be-47f7-4475-8381-d8e0bddd6802 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5e6146eb-31ff-437b-a594-8ddb1d63042e HTTP/1.1" status: 200  len: 857 time: 0.0856085
May 25 16:38:14.563771 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236ec32a-317d-4373-9a1c-d4ed10b4c1d1 req-c813b799-147c-49db-85a2-02434788d789 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=1186d694-166f-4246-b68b-e7ce60cb0f02&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0486867
May 25 16:38:14.655279 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e5e025e7-ae36-4417-a935-eddf9b788b25 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:14.675701 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-e5e025e7-ae36-4417-a935-eddf9b788b25 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:14.680010 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-e5e025e7-ae36-4417-a935-eddf9b788b25 admin admin] Usage tracker for resource:security_group_rule and tenant:d6119b2b441d4c1dbc0938c39721f2d7 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:14.683314 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-e5e025e7-ae36-4417-a935-eddf9b788b25 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:14.690060 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-e5e025e7-ae36-4417-a935-eddf9b788b25 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:14.763915 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236ec32a-317d-4373-9a1c-d4ed10b4c1d1 req-546e8dfe-ad01-417e-bfb9-7c04719ce119 service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1942923
May 25 16:38:14.801826 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e5e025e7-ae36-4417-a935-eddf9b788b25 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:14.808133 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e5e025e7-ae36-4417-a935-eddf9b788b25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:14.815724 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c0b9c268-422e-46ac-91a2-bd2416d31bdc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:14.863085 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5e025e7-ae36-4417-a935-eddf9b788b25 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c717f8d3-ea74-425d-8b7e-8b2247e42fb9,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:14.878430 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-e5e025e7-ae36-4417-a935-eddf9b788b25 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=d6119b2b441d4c1dbc0938c39721f2d7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5316322
May 25 16:38:14.879608 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-e5e025e7-ae36-4417-a935-eddf9b788b25 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:14.880954 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52242) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:14.947900 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5a61b3fa-da9d-4da7-ba4b-dbd519c36888 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:14.979243 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5a61b3fa-da9d-4da7-ba4b-dbd519c36888 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:15.023922 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-236ec32a-317d-4373-9a1c-d4ed10b4c1d1 req-52096eac-d5bc-471f-beda-f88a1146b73c service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2496450
May 25 16:38:15.044141 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5a61b3fa-da9d-4da7-ba4b-dbd519c36888 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:15.051836 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-064420cc-9b20-4796-ac5d-c8b698037790 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:15.068938 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52254) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:15.074683 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a61b3fa-da9d-4da7-ba4b-dbd519c36888 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c717f8d3-ea74-425d-8b7e-8b2247e42fb9,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:15.091654 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-5a61b3fa-da9d-4da7-ba4b-dbd519c36888 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:15.092843 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5a61b3fa-da9d-4da7-ba4b-dbd519c36888 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:15.094159 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-5a61b3fa-da9d-4da7-ba4b-dbd519c36888 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/c717f8d3-ea74-425d-8b7e-8b2247e42fb9 HTTP/1.1" status: 204  len: 168 time: 0.2116117
May 25 16:38:15.419595 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9d9e86a1-e8d3-4fb4-a93e-ac56f0e2ab7f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:15.449232 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9d9e86a1-e8d3-4fb4-a93e-ac56f0e2ab7f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:15.456819 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9d9e86a1-e8d3-4fb4-a93e-ac56f0e2ab7f admin admin] Usage tracker for resource:security_group_rule and tenant:6e0f555ecc614ef1b9833c4a35d50f8f is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:15.460345 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9d9e86a1-e8d3-4fb4-a93e-ac56f0e2ab7f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:15.469517 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9d9e86a1-e8d3-4fb4-a93e-ac56f0e2ab7f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:15.515805 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f5308a7-34c3-4ce7-a92b-24ade005ad51 req-1a4f4409-e8dd-414e-8ac8-1d83ea5fbc44 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:15.517773 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1f5308a7-34c3-4ce7-a92b-24ade005ad51 req-1a4f4409-e8dd-414e-8ac8-1d83ea5fbc44 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1642044
May 25 16:38:15.638117 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1f5308a7-34c3-4ce7-a92b-24ade005ad51 req-a9f784b7-d8ff-434d-b923-cd3a55caed34 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1073828
May 25 16:38:15.713776 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9d9e86a1-e8d3-4fb4-a93e-ac56f0e2ab7f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:15.719490 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9d9e86a1-e8d3-4fb4-a93e-ac56f0e2ab7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:15.731336 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-7f3c1dbc-ea4d-4056-9ec7-3dac1eb9f1d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:15.762271 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d9e86a1-e8d3-4fb4-a93e-ac56f0e2ab7f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ca4a6a7-9f1e-45ed-9a70-d741524d92fd,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:15.766758 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9d9e86a1-e8d3-4fb4-a93e-ac56f0e2ab7f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:15.786550 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-9d9e86a1-e8d3-4fb4-a93e-ac56f0e2ab7f admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=6e0f555ecc614ef1b9833c4a35d50f8f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7156172
May 25 16:38:15.789849 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52294) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:15.815966 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52300) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:15.843325 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3913fd5e-2723-43cf-abe7-3695fd52a77f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:15.853603 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52306) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:15.854358 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e9fc5a04-dd59-429c-b589-4782ca0419da admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:15.865515 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-3913fd5e-2723-43cf-abe7-3695fd52a77f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:15.869943 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-3913fd5e-2723-43cf-abe7-3695fd52a77f admin admin] Usage tracker for resource:security_group_rule and tenant:fb6ceceecb5748ab9811b8fe5a11cb2c is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:15.873134 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-3913fd5e-2723-43cf-abe7-3695fd52a77f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:15.879398 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-3913fd5e-2723-43cf-abe7-3695fd52a77f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:15.887449 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e9fc5a04-dd59-429c-b589-4782ca0419da admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:15.968814 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e9fc5a04-dd59-429c-b589-4782ca0419da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:15.976383 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3913fd5e-2723-43cf-abe7-3695fd52a77f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:15.978875 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d95e35ab-412b-4391-9280-24615936f40f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:15.987164 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3913fd5e-2723-43cf-abe7-3695fd52a77f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:15.990170 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9fc5a04-dd59-429c-b589-4782ca0419da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ca4a6a7-9f1e-45ed-9a70-d741524d92fd,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:15.992858 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-e9fc5a04-dd59-429c-b589-4782ca0419da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:16.002761 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e9fc5a04-dd59-429c-b589-4782ca0419da admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.003878 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-e9fc5a04-dd59-429c-b589-4782ca0419da admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/3ca4a6a7-9f1e-45ed-9a70-d741524d92fd HTTP/1.1" status: 204  len: 168 time: 0.2131684
May 25 16:38:16.010420 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-e5e025e7-ae36-4417-a935-eddf9b788b25 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:16.057720 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3913fd5e-2723-43cf-abe7-3695fd52a77f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7122dc52-7225-409d-9880-f712f59ae0c7,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:16.061482 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3913fd5e-2723-43cf-abe7-3695fd52a77f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:16.067471 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-3913fd5e-2723-43cf-abe7-3695fd52a77f admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=fb6ceceecb5748ab9811b8fe5a11cb2c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2453954
May 25 16:38:16.068005 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52314) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:16.143079 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d9cb2e2c-acc4-4015-929b-bb20c25c86e3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.193818 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d9cb2e2c-acc4-4015-929b-bb20c25c86e3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.201223 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ac9c8e0f-723f-459b-837b-d92fb0600ce2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.226638 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-ac9c8e0f-723f-459b-837b-d92fb0600ce2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:16.234197 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-ac9c8e0f-723f-459b-837b-d92fb0600ce2 admin admin] Usage tracker for resource:security_group_rule and tenant:75404366d77e4325bb99813b02104a89 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:16.245142 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-ac9c8e0f-723f-459b-837b-d92fb0600ce2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:16.255725 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-ac9c8e0f-723f-459b-837b-d92fb0600ce2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:16.314883 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d9cb2e2c-acc4-4015-929b-bb20c25c86e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.322093 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:16.351414 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9cb2e2c-acc4-4015-929b-bb20c25c86e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7122dc52-7225-409d-9880-f712f59ae0c7,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:16.354192 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d9cb2e2c-acc4-4015-929b-bb20c25c86e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:16.367493 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-d9cb2e2c-acc4-4015-929b-bb20c25c86e3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.383605 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-d9cb2e2c-acc4-4015-929b-bb20c25c86e3 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/7122dc52-7225-409d-9880-f712f59ae0c7 HTTP/1.1" status: 204  len: 168 time: 0.3071337
May 25 16:38:16.427549 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ac9c8e0f-723f-459b-837b-d92fb0600ce2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.433049 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ac9c8e0f-723f-459b-837b-d92fb0600ce2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.441679 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:16.515186 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-ac9c8e0f-723f-459b-837b-d92fb0600ce2 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=75404366d77e4325bb99813b02104a89&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6587477
May 25 16:38:16.516859 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac9c8e0f-723f-459b-837b-d92fb0600ce2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f8530b4a-7e93-48ad-b720-543383144a28,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:16.517999 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52326) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:16.520796 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ac9c8e0f-723f-459b-837b-d92fb0600ce2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:16.542617 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52330) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:16.575871 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.601769 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:16.608042 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Usage tracker for resource:security_group_rule and tenant:adc7766d4ffd409594cf930d1495e042 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:16.611781 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:16.620815 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:16.663866 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0b934cfc-90f9-4d33-930d-09731e96ce66 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.701694 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0b934cfc-90f9-4d33-930d-09731e96ce66 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.805584 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0b934cfc-90f9-4d33-930d-09731e96ce66 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.813552 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c296ff08-5b47-4194-a98a-2e60cc29ec30 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:16.840116 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b934cfc-90f9-4d33-930d-09731e96ce66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f8530b4a-7e93-48ad-b720-543383144a28,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:16.847264 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0b934cfc-90f9-4d33-930d-09731e96ce66 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:16.854756 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0b934cfc-90f9-4d33-930d-09731e96ce66 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.856693 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-0b934cfc-90f9-4d33-930d-09731e96ce66 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/f8530b4a-7e93-48ad-b720-543383144a28 HTTP/1.1" status: 204  len: 168 time: 0.3369751
May 25 16:38:16.862864 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.870516 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:16.897762 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d9cb2e2c-acc4-4015-929b-bb20c25c86e3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:17.007559 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=adc7766d4ffd409594cf930d1495e042&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4631171
May 25 16:38:17.008892 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f0e0e3a-c71e-4ff7-8ec9-92f3bf01880c,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:17.011836 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52352) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:17.035766 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:17.036113 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:17.036454 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:17.036785 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:17.037116 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:17.037485 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:17.037880 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:17.038415 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:17.038750 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:17.039077 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:17.040032 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:17.040032 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:17.048560 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:17.096199 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89a7d859-7404-43ac-a149-358da1548330 req-e7417f7a-c429-41f0-9504-d53cf74d7650 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:17.097800 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-89a7d859-7404-43ac-a149-358da1548330 req-e7417f7a-c429-41f0-9504-d53cf74d7650 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.2043633
May 25 16:38:17.150481 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-568d71ed-6d8f-41eb-a795-a8ce6c9152d0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:17.189592 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-89a7d859-7404-43ac-a149-358da1548330 req-69a8f9a9-23bc-4933-9349-a5413c88d40e tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0773437
May 25 16:38:17.193276 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-568d71ed-6d8f-41eb-a795-a8ce6c9152d0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:17.284430 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-568d71ed-6d8f-41eb-a795-a8ce6c9152d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:17.289810 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:17.302172 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-568d71ed-6d8f-41eb-a795-a8ce6c9152d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f0e0e3a-c71e-4ff7-8ec9-92f3bf01880c,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:17.307832 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-568d71ed-6d8f-41eb-a795-a8ce6c9152d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:17.312470 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-568d71ed-6d8f-41eb-a795-a8ce6c9152d0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:17.313795 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-568d71ed-6d8f-41eb-a795-a8ce6c9152d0 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/1f0e0e3a-c71e-4ff7-8ec9-92f3bf01880c HTTP/1.1" status: 204  len: 168 time: 0.3006148
May 25 16:38:17.502853 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52366) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:17.530221 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-39533f5a-1678-41ef-a69c-47d1694cc8e8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:17.561965 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-39533f5a-1678-41ef-a69c-47d1694cc8e8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:17.572788 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-39533f5a-1678-41ef-a69c-47d1694cc8e8 admin admin] Usage tracker for resource:security_group_rule and tenant:db26ec1a79824727bc7f61e4ff40efd4 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:17.576410 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-39533f5a-1678-41ef-a69c-47d1694cc8e8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:17.583332 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-39533f5a-1678-41ef-a69c-47d1694cc8e8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:17.737848 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-39533f5a-1678-41ef-a69c-47d1694cc8e8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:17.744089 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-39533f5a-1678-41ef-a69c-47d1694cc8e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:17.758995 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-50ff79c3-469a-4991-b68b-60f5c3ca97f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:17.812174 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-39533f5a-1678-41ef-a69c-47d1694cc8e8 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=db26ec1a79824727bc7f61e4ff40efd4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3067803
May 25 16:38:17.813178 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39533f5a-1678-41ef-a69c-47d1694cc8e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6289e1e0-0a83-40f1-b05a-e8746f016dea,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:17.815866 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52378) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:17.816581 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-39533f5a-1678-41ef-a69c-47d1694cc8e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:17.959380 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-cc6a630a-8e49-40c9-9ba1-d681aae001bb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:18.000623 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-cc6a630a-8e49-40c9-9ba1-d681aae001bb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:18.082135 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-cc6a630a-8e49-40c9-9ba1-d681aae001bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:18.082135 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-e4dc0f34-e71e-4c60-b1be-e0fc3fa88233 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:18.097293 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc6a630a-8e49-40c9-9ba1-d681aae001bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6289e1e0-0a83-40f1-b05a-e8746f016dea,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:18.100647 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-cc6a630a-8e49-40c9-9ba1-d681aae001bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:18.113597 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-cc6a630a-8e49-40c9-9ba1-d681aae001bb admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:18.114799 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-cc6a630a-8e49-40c9-9ba1-d681aae001bb admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/6289e1e0-0a83-40f1-b05a-e8746f016dea HTTP/1.1" status: 204  len: 168 time: 0.2975256
May 25 16:38:18.532724 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6e471e5-c254-41d9-8927-14d841917cbc req-ae51e2f8-70ab-49b5-b8fc-a3aab2251da8 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:18.537222 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f6e471e5-c254-41d9-8927-14d841917cbc req-ae51e2f8-70ab-49b5-b8fc-a3aab2251da8 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.2195432
May 25 16:38:18.773737 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-05a7c137-f72b-48ed-bf79-eb6ce10a788d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:18.775277 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-05a7c137-f72b-48ed-bf79-eb6ce10a788d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/networks?id=e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 200  len: 814 time: 0.1911156
May 25 16:38:18.791872 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f6e471e5-c254-41d9-8927-14d841917cbc req-0a4d0301-c0a7-474e-8ee0-8842c1e2a629 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2456002
May 25 16:38:18.808529 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-adfe40cc-3389-427b-a16e-63ec48f64971 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/quotas/2441ab18acee4d4c9e276ba69a458348 HTTP/1.1" status: 200  len: 375 time: 0.0158803
May 25 16:38:18.915667 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-d276927b-0639-4de0-927d-fb7d92d6252b tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=2441ab18acee4d4c9e276ba69a458348&fields=id HTTP/1.1" status: 200  len: 255 time: 0.0945380
May 25 16:38:19.112955 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-c805aebc-8c2c-4d0b-838d-ea36ef7fd11a service neutron] 10.222.0.73 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1844659
May 25 16:38:19.276870 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-c12bae02-df4c-463f-a0a1-c0319f57da3c service neutron] 10.222.0.73 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1628952
May 25 16:38:19.542957 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cf69220a-39d3-468c-bef3-1e49ace5e3eb req-112e1a6a-23f7-4dfa-bcfe-458ab491231f tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 210 time: 0.0683575
May 25 16:38:20.201357 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bf3aaf3-a4d0-465a-8adf-61d3f164db04 req-22accf09-1f96-4ea8-bc67-782eda6248bb tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:20.203835 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0bf3aaf3-a4d0-465a-8adf-61d3f164db04 req-22accf09-1f96-4ea8-bc67-782eda6248bb tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1696448
May 25 16:38:20.371864 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0bf3aaf3-a4d0-465a-8adf-61d3f164db04 req-333a4743-d5b4-4307-91d5-5298a709ad74 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1608653
May 25 16:38:20.745333 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-efb38a59-62d0-4d50-ab29-678b044d5a14 req-577ab969-6c30-4363-a977-13f1cfcf685b tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 210 time: 0.0602143
May 25 16:38:21.203069 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-15697764-65be-4cfb-99fc-85efee87a3f3 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:21.204665 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-15697764-65be-4cfb-99fc-85efee87a3f3 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "GET /v2.0/networks?id=e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 200  len: 814 time: 0.3064287
May 25 16:38:21.239535 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Request body: {'port': {'device_id': '31786e99-b18d-4a80-9959-28c18ca63fd3', 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42', 'admin_state_up': True, 'tenant_id': '2441ab18acee4d4c9e276ba69a458348'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:21.415890 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:21.420164 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Usage tracker for resource:port and tenant:2441ab18acee4d4c9e276ba69a458348 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:21.423318 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Quota usage for port was recalculated. Used quota:1. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:21.431641 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:21.443728 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Made reservation on behalf of 2441ab18acee4d4c9e276ba69a458348 for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:38:21.447077 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:21.718421 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Allocated IP 172.20.0.12 (e55be10d-206c-4bb4-8273-c9b859b11a42/c4c2aef1-f957-410f-9038-a1d13568aa6e/dc96a24c-e6ea-4174-9a11-ac0ae925b8fb) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:38:21.729579 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c005d1f3-379c-4d37-816d-b847f24c1265 req-4eab80e4-6b02-4c1e-9f7e-a9397225dd37 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:21.737718 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c005d1f3-379c-4d37-816d-b847f24c1265 req-4eab80e4-6b02-4c1e-9f7e-a9397225dd37 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1889787
May 25 16:38:21.830893 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c005d1f3-379c-4d37-816d-b847f24c1265 req-c75a2bf5-0eaa-41f2-848a-bdd204516364 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0927386
May 25 16:38:22.001864 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e2b9b828-2c00-4b15-968a-baa55c34e655 req-fc28400b-1b2f-4565-b39f-716524dac124 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 210 time: 0.0680552
May 25 16:38:22.100099 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:22.139687 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:22.146820 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-a0f3d492-da4c-419f-bd2f-44c00a30ade4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:22.158187 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['39034fee-da76-49d9-a359-2be89ce60575'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:38:22.275913 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Pushing event updated for resources: {'Port': ['ID=dc96a24c-e6ea-4174-9a11-ac0ae925b8fb,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:22.289738 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:22.303468 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Network e55be10d-206c-4bb4-8273-c9b859b11a42 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:38:22.305942 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:38:22.309285 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:38:22.318629 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:22.320192 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:22.349376 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.1164224
May 25 16:38:22.363671 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Request body: {'port': {'device_id': '31786e99-b18d-4a80-9959-28c18ca63fd3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:22.408423 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52620) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:22.520718 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52628) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:22.548388 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:22.725116 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:22.745862 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:22.750259 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Usage tracker for resource:security_group_rule and tenant:8f03b0d46b614a5b8dcc6aeeccd1a9aa is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:22.756378 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:22.765653 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:22.869350 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:22.880206 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:22.914945 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52648) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:22.956064 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:22.970805 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=8f03b0d46b614a5b8dcc6aeeccd1a9aa&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5613005
May 25 16:38:22.994790 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52654) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:23.045276 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da1e6078-b419-4042-81a8-5fee2e00b7ff,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:23.048037 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-39194e1c-a710-41d3-9d0d-57aa0f0fa493 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.077806 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:23.078302 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:23.078838 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:23.079770 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:23.080432 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:23.080935 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:23.081303 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:23.081672 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:23.082085 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:23.082566 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:23.082923 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:23.083239 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:23.090015 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-39194e1c-a710-41d3-9d0d-57aa0f0fa493 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:23.090502 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1556adc8-a151-49f9-9a94-6620634a46aa admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.094407 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-39194e1c-a710-41d3-9d0d-57aa0f0fa493 admin admin] Usage tracker for resource:security_group_rule and tenant:ed4a6081d2c946d4903e22ccab5f435f is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:23.097558 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-39194e1c-a710-41d3-9d0d-57aa0f0fa493 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:23.104570 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-39194e1c-a710-41d3-9d0d-57aa0f0fa493 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:23.120543 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:23.127089 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-1556adc8-a151-49f9-9a94-6620634a46aa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:23.133456 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dc96a24c-e6ea-4174-9a11-ac0ae925b8fb {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:38:23.138763 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-1556adc8-a151-49f9-9a94-6620634a46aa admin admin] Usage tracker for resource:security_group_rule and tenant:0fe20fcec1b4452ca4c1d66b07fe867b is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:23.148168 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.150765 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-1556adc8-a151-49f9-9a94-6620634a46aa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:23.159845 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-1556adc8-a151-49f9-9a94-6620634a46aa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:23.166518 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-60321d0e-4b02-4601-b47c-ef6485885bca admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.207282 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-60321d0e-4b02-4601-b47c-ef6485885bca admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.228194 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Transition to ACTIVE for port object dc96a24c-e6ea-4174-9a11-ac0ae925b8fb will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:38:23.248701 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00f36a13-a934-4965-8c28-337be83d0bac req-7aeedeba-ea88-43c6-ac50-13eb762cec44 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:23.250164 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-00f36a13-a934-4965-8c28-337be83d0bac req-7aeedeba-ea88-43c6-ac50-13eb762cec44 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.2373686
May 25 16:38:23.253466 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.280888 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-39194e1c-a710-41d3-9d0d-57aa0f0fa493 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.284646 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-39194e1c-a710-41d3-9d0d-57aa0f0fa493 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.287156 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:23.293630 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:23.336161 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-60321d0e-4b02-4601-b47c-ef6485885bca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.344293 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-39194e1c-a710-41d3-9d0d-57aa0f0fa493 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=ed4a6081d2c946d4903e22ccab5f435f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8201869
May 25 16:38:23.347172 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52664) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:23.353292 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39194e1c-a710-41d3-9d0d-57aa0f0fa493 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2c80c1e-e0ba-4baa-b33f-5c40ade15dd3,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:23.369298 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-39194e1c-a710-41d3-9d0d-57aa0f0fa493 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:23.369759 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b78aaaa7-23d7-4018-9771-97a870760ef3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.023s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:23.388099 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60321d0e-4b02-4601-b47c-ef6485885bca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da1e6078-b419-4042-81a8-5fee2e00b7ff,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:23.402478 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-60321d0e-4b02-4601-b47c-ef6485885bca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:23.413255 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-60321d0e-4b02-4601-b47c-ef6485885bca admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.417877 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-60321d0e-4b02-4601-b47c-ef6485885bca admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/da1e6078-b419-4042-81a8-5fee2e00b7ff HTTP/1.1" status: 204  len: 168 time: 0.4219539
May 25 16:38:23.463230 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d0c103f5-62b5-4893-8e0b-8d8a60f16ec5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.490401 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d0c103f5-62b5-4893-8e0b-8d8a60f16ec5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.532889 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-00f36a13-a934-4965-8c28-337be83d0bac req-0e19bf71-2a8c-4219-a62a-925dd0577c47 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2727721
May 25 16:38:23.540546 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Pushing event updated for resources: {'Port': ['ID=dc96a24c-e6ea-4174-9a11-ac0ae925b8fb,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:23.562780 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d0c103f5-62b5-4893-8e0b-8d8a60f16ec5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.567710 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-4ac89265-2851-42d3-a6d2-902eb0f3ed4f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:23.573569 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.286s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:23.579261 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0c103f5-62b5-4893-8e0b-8d8a60f16ec5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2c80c1e-e0ba-4baa-b33f-5c40ade15dd3,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:23.582007 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-d0c103f5-62b5-4893-8e0b-8d8a60f16ec5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:23.587298 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d0c103f5-62b5-4893-8e0b-8d8a60f16ec5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.589459 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-d0c103f5-62b5-4893-8e0b-8d8a60f16ec5 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/b2c80c1e-e0ba-4baa-b33f-5c40ade15dd3 HTTP/1.1" status: 204  len: 168 time: 0.2393327
May 25 16:38:23.610084 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9c29f0d-d7c6-4735-9e42-ed29397114b6 req-26d9734c-f1a4-4ad5-baf1-e162cd972cff tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:23.610939 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-a9c29f0d-d7c6-4735-9e42-ed29397114b6 req-26d9734c-f1a4-4ad5-baf1-e162cd972cff tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Synchronizing usage tracker for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:38:23.641467 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Attempting to bind port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:38:23.641856 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Attempting to bind port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:38:23.642634 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Attempting to bind port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb on network e55be10d-206c-4bb4-8273-c9b859b11a42 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:38:23.658494 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb on network e55be10d-206c-4bb4-8273-c9b859b11a42 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:38:23.658820 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Attempting to bind port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb on network e55be10d-206c-4bb4-8273-c9b859b11a42 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:38:23.670834 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1556adc8-a151-49f9-9a94-6620634a46aa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.672010 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 38, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:38:23.672367 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Checking segment: {'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:38:23.672754 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Bound using segment: {'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:38:23.673172 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Bound port: dc96a24c-e6ea-4174-9a11-ac0ae925b8fb, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:38:23.673528 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.685628 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-a9c29f0d-d7c6-4735-9e42-ed29397114b6 req-26d9734c-f1a4-4ad5-baf1-e162cd972cff tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Unset dirty status for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:38:23.686770 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a9c29f0d-d7c6-4735-9e42-ed29397114b6 req-26d9734c-f1a4-4ad5-baf1-e162cd972cff tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 932 time: 0.5331974
May 25 16:38:23.690112 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1556adc8-a151-49f9-9a94-6620634a46aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.700214 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-bc1461ee-6b16-4ef9-9f1b-5d987a476941 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:23.792591 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52676) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:23.810996 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-207752bf-73b5-4d7b-8172-ad50dea29f86 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.812666 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1556adc8-a151-49f9-9a94-6620634a46aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=50b73c76-46ab-4144-be88-9df16e32aec7,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:23.826719 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-1556adc8-a151-49f9-9a94-6620634a46aa admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=0fe20fcec1b4452ca4c1d66b07fe867b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9107709
May 25 16:38:23.831698 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-1556adc8-a151-49f9-9a94-6620634a46aa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:23.836018 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52680) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:23.842566 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-207752bf-73b5-4d7b-8172-ad50dea29f86 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:23.847200 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-207752bf-73b5-4d7b-8172-ad50dea29f86 admin admin] Usage tracker for resource:security_group_rule and tenant:175172325f824907b73f0fc40032e9b4 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:23.849541 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a9c29f0d-d7c6-4735-9e42-ed29397114b6 req-c200dc33-9acb-458d-b5fc-5cb4454669d2 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1502128
May 25 16:38:23.850220 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-207752bf-73b5-4d7b-8172-ad50dea29f86 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:23.856919 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-207752bf-73b5-4d7b-8172-ad50dea29f86 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:23.902199 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] For port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:38:23.916070 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] For port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=dc96a24c-e6ea-4174-9a11-ac0ae925b8fb,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:38:23.928518 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.937052 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:23.947943 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-207752bf-73b5-4d7b-8172-ad50dea29f86 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.951834 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-207752bf-73b5-4d7b-8172-ad50dea29f86 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:23.959308 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-39533f5a-1678-41ef-a69c-47d1694cc8e8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:23.973700 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-56776b02-d539-4c63-9a40-31b214605a43 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.001122 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-207752bf-73b5-4d7b-8172-ad50dea29f86 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf1f5eaf-71ea-4656-9924-d43aa80700c1,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:24.009451 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:24.010119 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.011461 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] 10.222.0.76 "PUT /v2.0/ports/dc96a24c-e6ea-4174-9a11-ac0ae925b8fb HTTP/1.1" status: 200  len: 1094 time: 1.6529124
May 25 16:38:24.011877 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '31786e99-b18d-4a80-9959-28c18ca63fd3', 'tag': 'dc96a24c-e6ea-4174-9a11-ac0ae925b8fb'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:38:24.017175 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-207752bf-73b5-4d7b-8172-ad50dea29f86 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=175172325f824907b73f0fc40032e9b4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2233403
May 25 16:38:24.020652 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-207752bf-73b5-4d7b-8172-ad50dea29f86 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:24.021313 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52690) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:24.060168 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-56776b02-d539-4c63-9a40-31b214605a43 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.097925 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c9ba412c-05fe-42ac-8e54-94a019bf91aa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.137856 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c9ba412c-05fe-42ac-8e54-94a019bf91aa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.138775 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '31786e99-b18d-4a80-9959-28c18ca63fd3', 'tag': 'dc96a24c-e6ea-4174-9a11-ac0ae925b8fb', 'status': 'completed', 'code': 200}
May 25 16:38:24.150260 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52694) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:24.158931 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Pushing event updated for resources: {'Port': ['ID=dc96a24c-e6ea-4174-9a11-ac0ae925b8fb,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:24.165312 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:24.198258 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-57969d3d-d3b0-4467-b93b-a211646d5be8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.210517 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-d8d1605a-dcbd-4f40-b133-608339dcaa61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:24.211994 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-d8d1605a-dcbd-4f40-b133-608339dcaa61 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=2441ab18acee4d4c9e276ba69a458348&device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 1097 time: 0.1298108
May 25 16:38:24.220251 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-56776b02-d539-4c63-9a40-31b214605a43 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.225600 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:24.227728 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-57969d3d-d3b0-4467-b93b-a211646d5be8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:24.232412 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-57969d3d-d3b0-4467-b93b-a211646d5be8 admin admin] Usage tracker for resource:security_group_rule and tenant:7431c04a42b247cbb4734f708eaf3738 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:24.235495 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-57969d3d-d3b0-4467-b93b-a211646d5be8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:24.242544 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-57969d3d-d3b0-4467-b93b-a211646d5be8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:24.270920 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c9ba412c-05fe-42ac-8e54-94a019bf91aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.278372 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-5a61b3fa-da9d-4da7-ba4b-dbd519c36888 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:24.294681 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9ba412c-05fe-42ac-8e54-94a019bf91aa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf1f5eaf-71ea-4656-9924-d43aa80700c1,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:24.299882 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c9ba412c-05fe-42ac-8e54-94a019bf91aa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:24.314294 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-56776b02-d539-4c63-9a40-31b214605a43 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.314881 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c9ba412c-05fe-42ac-8e54-94a019bf91aa admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.316164 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c9ba412c-05fe-42ac-8e54-94a019bf91aa admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/cf1f5eaf-71ea-4656-9924-d43aa80700c1 HTTP/1.1" status: 204  len: 168 time: 0.2937002
May 25 16:38:24.323353 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-56776b02-d539-4c63-9a40-31b214605a43 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/50b73c76-46ab-4144-be88-9df16e32aec7 HTTP/1.1" status: 204  len: 168 time: 0.4856575
May 25 16:38:24.324937 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56776b02-d539-4c63-9a40-31b214605a43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=50b73c76-46ab-4144-be88-9df16e32aec7,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:24.328607 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-5a742789-a9fa-465f-a351-8c4a7c2b00ad service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=dc96a24c-e6ea-4174-9a11-ac0ae925b8fb HTTP/1.1" status: 200  len: 217 time: 0.0948913
May 25 16:38:24.329326 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-56776b02-d539-4c63-9a40-31b214605a43 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:24.391358 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-57969d3d-d3b0-4467-b93b-a211646d5be8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.398808 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-57969d3d-d3b0-4467-b93b-a211646d5be8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.410034 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3913fd5e-2723-43cf-abe7-3695fd52a77f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:24.418554 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-d1aee4cf-4a97-444e-8f3d-64bc86daf6b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:24.420151 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-d1aee4cf-4a97-444e-8f3d-64bc86daf6b1 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c4c2aef1-f957-410f-9038-a1d13568aa6e HTTP/1.1" status: 200  len: 854 time: 0.0826559
May 25 16:38:24.460893 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-57969d3d-d3b0-4467-b93b-a211646d5be8 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=7431c04a42b247cbb4734f708eaf3738&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3054955
May 25 16:38:24.460893 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57969d3d-d3b0-4467-b93b-a211646d5be8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=718c3707-9559-4aaf-ae30-651afdbfc39f,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:24.462463 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52706) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:24.474310 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-57969d3d-d3b0-4467-b93b-a211646d5be8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:24.486308 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-aa47cc96-c97f-4f82-a45c-cb1f5aa6bf49 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e55be10d-206c-4bb4-8273-c9b859b11a42&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0581472
May 25 16:38:24.639703 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c9e215ea-b6b9-402e-b8ea-14c95f2343c4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.654860 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52716) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:24.759608 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c9e215ea-b6b9-402e-b8ea-14c95f2343c4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.847720 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-e1dbda33-89ce-48d8-8158-c97ad504636c service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3378975
May 25 16:38:24.870571 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-48a8f9f4-bb02-44a4-ab25-ca21ba446884 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.927314 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-48a8f9f4-bb02-44a4-ab25-ca21ba446884 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:24.930187 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52728) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:24.934882 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-48a8f9f4-bb02-44a4-ab25-ca21ba446884 admin admin] Usage tracker for resource:security_group_rule and tenant:d5d0172307454fed81c642bbf5b099e9 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:24.961870 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-48a8f9f4-bb02-44a4-ab25-ca21ba446884 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:24.971856 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-48a8f9f4-bb02-44a4-ab25-ca21ba446884 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:24.974766 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6b5deabc-3212-4ca7-823d-104e12850a42 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:24.975793 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e23c7fc-64bf-4e6f-b7b4-f709e3b7acb3 req-0d718bb1-2c77-438d-8d68-cbc4b4172b6f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:24.982752 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0e23c7fc-64bf-4e6f-b7b4-f709e3b7acb3 req-0d718bb1-2c77-438d-8d68-cbc4b4172b6f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.2928090
May 25 16:38:25.002780 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c9e215ea-b6b9-402e-b8ea-14c95f2343c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.003126 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-6b5deabc-3212-4ca7-823d-104e12850a42 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:25.011406 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9d9e86a1-e8d3-4fb4-a93e-ac56f0e2ab7f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:25.016995 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-6b5deabc-3212-4ca7-823d-104e12850a42 admin admin] Usage tracker for resource:security_group_rule and tenant:ed3ecb6a91a940b58eaa96a43e9c7796 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:25.021773 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-6b5deabc-3212-4ca7-823d-104e12850a42 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:25.034483 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-6b5deabc-3212-4ca7-823d-104e12850a42 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:25.085971 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9e215ea-b6b9-402e-b8ea-14c95f2343c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=718c3707-9559-4aaf-ae30-651afdbfc39f,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:25.094521 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c9e215ea-b6b9-402e-b8ea-14c95f2343c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:25.135573 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c9e215ea-b6b9-402e-b8ea-14c95f2343c4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.136663 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-c9e215ea-b6b9-402e-b8ea-14c95f2343c4 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/718c3707-9559-4aaf-ae30-651afdbfc39f HTTP/1.1" status: 204  len: 168 time: 0.6685019
May 25 16:38:25.153380 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0e23c7fc-64bf-4e6f-b7b4-f709e3b7acb3 req-6a323bc5-f503-4e3a-a7b7-51b88e1bdfde tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1696837
May 25 16:38:25.169101 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-464be5f4-2f5b-48f9-a9b2-c3d98a8132a1 req-a94de1c1-e03a-404a-b14b-bc3272a4bce7 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3130515
May 25 16:38:25.178113 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-48a8f9f4-bb02-44a4-ab25-ca21ba446884 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.191204 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-48a8f9f4-bb02-44a4-ab25-ca21ba446884 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.203461 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-aa600be0-0b1c-4afd-a96f-fc2e1d022f50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:25.222500 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb854423-7f96-4178-9628-a9bba80b6335 req-affe59ca-fb0a-4fae-99fb-8b17373c1e7a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:25.224056 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bb854423-7f96-4178-9628-a9bba80b6335 req-affe59ca-fb0a-4fae-99fb-8b17373c1e7a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 944 time: 0.1999624
May 25 16:38:25.262707 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6b5deabc-3212-4ca7-823d-104e12850a42 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.278175 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6b5deabc-3212-4ca7-823d-104e12850a42 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.312454 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-6b5deabc-3212-4ca7-823d-104e12850a42 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=ed3ecb6a91a940b58eaa96a43e9c7796&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3811815
May 25 16:38:25.314273 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52742) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:25.317670 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-48a8f9f4-bb02-44a4-ab25-ca21ba446884 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=d5d0172307454fed81c642bbf5b099e9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6618612
May 25 16:38:25.319173 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52746) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:25.322013 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48a8f9f4-bb02-44a4-ab25-ca21ba446884 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=749a3f5f-a7a2-4c62-a196-9282a71de652,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:25.362221 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-48a8f9f4-bb02-44a4-ab25-ca21ba446884 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:25.363102 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-70550259-ec68-42b0-b344-a6d16fe82e65 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.057s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:25.380953 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bb854423-7f96-4178-9628-a9bba80b6335 req-2bb8679a-b15b-4c09-b0dc-1ee9666060c4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1505718
May 25 16:38:25.438345 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-39cc1bd6-8e02-44aa-b0a3-cab42a074313 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.454100 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b5deabc-3212-4ca7-823d-104e12850a42 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f8539647-8ec2-42b4-914d-e848d18ba885,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:25.473361 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-6b5deabc-3212-4ca7-823d-104e12850a42 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:25.478540 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1da177b1-1632-4ea6-bd6f-48b42c73ea2f req-b218cfa6-16c1-4aef-b7ee-4ebb448b2a00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:25.480558 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1da177b1-1632-4ea6-bd6f-48b42c73ea2f req-b218cfa6-16c1-4aef-b7ee-4ebb448b2a00 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=2441ab18acee4d4c9e276ba69a458348&device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 1097 time: 0.2325041
May 25 16:38:25.481088 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-39cc1bd6-8e02-44aa-b0a3-cab42a074313 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.498170 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:38:25.571917 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-39cc1bd6-8e02-44aa-b0a3-cab42a074313 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.580599 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:25.589795 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39cc1bd6-8e02-44aa-b0a3-cab42a074313 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=749a3f5f-a7a2-4c62-a196-9282a71de652,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:25.594894 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-39cc1bd6-8e02-44aa-b0a3-cab42a074313 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:25.601932 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-39cc1bd6-8e02-44aa-b0a3-cab42a074313 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.605970 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-39cc1bd6-8e02-44aa-b0a3-cab42a074313 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/749a3f5f-a7a2-4c62-a196-9282a71de652 HTTP/1.1" status: 204  len: 168 time: 0.2853823
May 25 16:38:25.714053 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1e3a956f-399b-47cb-8940-32ca2352011e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.760762 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1e3a956f-399b-47cb-8940-32ca2352011e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.816437 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1da177b1-1632-4ea6-bd6f-48b42c73ea2f req-ef7d2012-2374-4c9e-9c94-7ce860efbcf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:25.818069 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1da177b1-1632-4ea6-bd6f-48b42c73ea2f req-ef7d2012-2374-4c9e-9c94-7ce860efbcf6 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 200  len: 915 time: 0.3197687
May 25 16:38:25.898874 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1da177b1-1632-4ea6-bd6f-48b42c73ea2f req-f7bde582-48e1-4da1-b190-7657c649ef0d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=dc96a24c-e6ea-4174-9a11-ac0ae925b8fb HTTP/1.1" status: 200  len: 217 time: 0.0734351
May 25 16:38:25.949440 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1e3a956f-399b-47cb-8940-32ca2352011e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.960808 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:25.984462 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e3a956f-399b-47cb-8940-32ca2352011e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f8539647-8ec2-42b4-914d-e848d18ba885,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:25.989317 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-1e3a956f-399b-47cb-8940-32ca2352011e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:25.992268 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1e3a956f-399b-47cb-8940-32ca2352011e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:25.993080 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-1e3a956f-399b-47cb-8940-32ca2352011e admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/f8539647-8ec2-42b4-914d-e848d18ba885 HTTP/1.1" status: 204  len: 168 time: 0.6745124
May 25 16:38:26.001243 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1da177b1-1632-4ea6-bd6f-48b42c73ea2f req-ce5a96f7-f599-4b7f-8ed8-d2bcb76d61cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:26.002888 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1da177b1-1632-4ea6-bd6f-48b42c73ea2f req-ce5a96f7-f599-4b7f-8ed8-d2bcb76d61cf service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c4c2aef1-f957-410f-9038-a1d13568aa6e HTTP/1.1" status: 200  len: 854 time: 0.0919046
May 25 16:38:26.069777 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1da177b1-1632-4ea6-bd6f-48b42c73ea2f req-220a3da3-a92e-4bc3-ac69-326bb72edbd7 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e55be10d-206c-4bb4-8273-c9b859b11a42&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0544338
May 25 16:38:26.237734 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52788) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:26.270017 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-469ed7dd-3103-463e-a414-a16a13d93652 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:26.291168 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-469ed7dd-3103-463e-a414-a16a13d93652 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:26.295446 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-469ed7dd-3103-463e-a414-a16a13d93652 admin admin] Usage tracker for resource:security_group_rule and tenant:b8f3964d38c5442490941ed540c3204c is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:26.299325 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-469ed7dd-3103-463e-a414-a16a13d93652 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:26.305750 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-469ed7dd-3103-463e-a414-a16a13d93652 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:26.349130 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1da177b1-1632-4ea6-bd6f-48b42c73ea2f req-e5078dca-0fb1-457f-8f65-8d1c71db76a8 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2627072
May 25 16:38:26.359115 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68d579d2-8728-4215-bb05-260eb5900961 req-bb490b41-cab1-4b88-b4d8-f879600b8b37 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:26.360682 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-68d579d2-8728-4215-bb05-260eb5900961 req-bb490b41-cab1-4b88-b4d8-f879600b8b37 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 946 time: 0.2474663
May 25 16:38:26.431663 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-469ed7dd-3103-463e-a414-a16a13d93652 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:26.437504 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-469ed7dd-3103-463e-a414-a16a13d93652 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:26.452123 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-568d71ed-6d8f-41eb-a795-a8ce6c9152d0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:26.505428 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-469ed7dd-3103-463e-a414-a16a13d93652 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0d257502-51da-4769-b1d9-d170d86f58ad,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:26.512464 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-469ed7dd-3103-463e-a414-a16a13d93652 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:26.528458 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-68d579d2-8728-4215-bb05-260eb5900961 req-8b2c9c9d-b3aa-4647-aee8-5d566ecfcfee tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0907409
May 25 16:38:26.567639 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-469ed7dd-3103-463e-a414-a16a13d93652 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=b8f3964d38c5442490941ed540c3204c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3257537
May 25 16:38:26.568551 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52802) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:26.576804 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-431977d7-9b58-412f-b7a4-d36ccb624475 req-d2a58212-b5c1-4495-b2cc-a447679e245a tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:26.578520 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-431977d7-9b58-412f-b7a4-d36ccb624475 req-d2a58212-b5c1-4495-b2cc-a447679e245a tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.2919724
May 25 16:38:26.585448 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1da177b1-1632-4ea6-bd6f-48b42c73ea2f req-9ca8b9ad-68dc-4579-aac4-f78230e44a78 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2123852
May 25 16:38:26.667710 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-957da9c6-9208-4f93-9436-7106fd10b2e8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:26.675671 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-431977d7-9b58-412f-b7a4-d36ccb624475 req-3e91eeb4-e605-4318-87d9-e7006a246278 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0887759
May 25 16:38:26.713769 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-957da9c6-9208-4f93-9436-7106fd10b2e8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:26.722349 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 52810) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:26.829672 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9d72c96-3862-4aa5-bae1-c9bab9e2ff91 req-8ed0f232-16bd-425b-b0bf-1e85766b3412 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:26.831107 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a9d72c96-3862-4aa5-bae1-c9bab9e2ff91 req-8ed0f232-16bd-425b-b0bf-1e85766b3412 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 944 time: 0.1127748
May 25 16:38:26.832831 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-957da9c6-9208-4f93-9436-7106fd10b2e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:26.839028 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-84893781-13b9-46f6-8331-3140f0d2e6b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:26.854146 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-957da9c6-9208-4f93-9436-7106fd10b2e8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d257502-51da-4769-b1d9-d170d86f58ad,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:26.856246 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-957da9c6-9208-4f93-9436-7106fd10b2e8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:26.861018 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-957da9c6-9208-4f93-9436-7106fd10b2e8 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/0d257502-51da-4769-b1d9-d170d86f58ad HTTP/1.1" status: 204  len: 168 time: 0.2902944
May 25 16:38:26.862210 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-957da9c6-9208-4f93-9436-7106fd10b2e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:26.904298 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a9d72c96-3862-4aa5-bae1-c9bab9e2ff91 req-dcd1a24f-6c76-4ce3-a464-ef34195b6659 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0602069
May 25 16:38:27.007386 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1081180554-network', 'tenant_id': '8788479dfd374aaa9b7cd176d29fdf98'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:27.012222 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:27.016374 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Usage tracker for resource:network and tenant:8788479dfd374aaa9b7cd176d29fdf98 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:27.021003 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:27.027834 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:27.039775 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Made reservation on behalf of 8788479dfd374aaa9b7cd176d29fdf98 for: {'network': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:38:27.042198 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:27.054980 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:27.070321 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:27.074181 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Usage tracker for resource:security_group_rule and tenant:8788479dfd374aaa9b7cd176d29fdf98 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:27.076985 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:27.083279 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:27.179197 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:27.184363 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:27.189018 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:27.207743 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device dc96a24c-e6ea-4174-9a11-ac0ae925b8fb details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:38:27.217830 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 436}  {{(pid=92013) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:38:27.233206 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92101fac-7cc3-4c34-aa5e-6940de94a166,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:27.236729 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:27.239875 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:27.240042 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.segments_db [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Added segment 752346b3-2fea-4467-bab6-0947b3533e4a of type vlan for network cc412065-ef9d-40a9-ac24-90f17fd05562
May 25 16:38:27.274204 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:27.309898 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:27.312525 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:27.313356 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:27.321318 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-e3ec8fee-0e31-4c99-b46f-56fb862d42a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:27.400875 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=dc96a24c-e6ea-4174-9a11-ac0ae925b8fb,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:27.425823 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': 'dc96a24c-e6ea-4174-9a11-ac0ae925b8fb', 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42', 'port_id': 'dc96a24c-e6ea-4174-9a11-ac0ae925b8fb', 'mac_address': 'fa:16:3e:56:b1:72', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 410, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c4c2aef1-f957-410f-9038-a1d13568aa6e', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:38:27.433157 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.7097578
May 25 16:38:27.434404 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Pushing event updated for resources: {'Network': ['ID=cc412065-ef9d-40a9-ac24-90f17fd05562,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:27.436182 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52842) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:27.438736 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:27.442827 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Request body: {'subnet': {'network_id': 'cc412065-ef9d-40a9-ac24-90f17fd05562', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1081180554-subnet', 'tenant_id': '8788479dfd374aaa9b7cd176d29fdf98', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:27.448301 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:27.452879 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Usage tracker for resource:subnet and tenant:8788479dfd374aaa9b7cd176d29fdf98 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:27.457150 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:27.463645 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:27.476541 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Made reservation on behalf of 8788479dfd374aaa9b7cd176d29fdf98 for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:38:27.479428 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-697612'] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:27.496659 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:27.507900 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network cc412065-ef9d-40a9-ac24-90f17fd05562 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:38:27.622501 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dc96a24c-e6ea-4174-9a11-ac0ae925b8fb {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:38:27.655519 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=dc96a24c-e6ea-4174-9a11-ac0ae925b8fb,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:27.666292 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:27.671127 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:27.765972 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=dc96a24c-e6ea-4174-9a11-ac0ae925b8fb,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:27.776477 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:27.777077 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:27.777649 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:27.778126 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:27.778650 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:27.779155 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:27.779642 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:27.780128 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:27.780652 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:27.781178 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:27.781676 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:27.782136 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:27.788034 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:27.898873 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-586ee9d3-c248-42e8-a9c1-94c2aa4244db req-efa7b9b4-7cd2-448c-bd55-2a5c53344d73 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:27.901993 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-586ee9d3-c248-42e8-a9c1-94c2aa4244db req-efa7b9b4-7cd2-448c-bd55-2a5c53344d73 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 946 time: 0.2163913
May 25 16:38:28.025701 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-586ee9d3-c248-42e8-a9c1-94c2aa4244db req-2e2cf2d2-87ea-4fb8-8e29-7667f141953a tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1140730
May 25 16:38:28.028653 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['dc96a24c-e6ea-4174-9a11-ac0ae925b8fb'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:38:28.105870 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-191a9bf1-51f5-4209-931b-8e86ede905da req-d4606e35-a2ee-4970-969e-5832e1a447ce tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:28.107806 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-191a9bf1-51f5-4209-931b-8e86ede905da req-d4606e35-a2ee-4970-969e-5832e1a447ce tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1975241
May 25 16:38:28.233880 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-191a9bf1-51f5-4209-931b-8e86ede905da req-8a70b85e-7b43-467e-8ac3-bb6e33a0ec69 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1187961
May 25 16:38:28.283978 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7721570', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-697626'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:28.296623 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ae794e5a-f80f-4115-ad78-bfe1c276f1a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:28.395307 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Pushing event updated for resources: {'Subnet': ['ID=06070c87-31bb-4f80-a9d7-4df17bf0a9e0,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:28.400112 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:28.402813 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Checking segment: {'id': '752346b3-2fea-4467-bab6-0947b3533e4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 436, 'network_id': 'cc412065-ef9d-40a9-ac24-90f17fd05562'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:38:28.403149 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Network hostable DHCP agents. Network: cc412065-ef9d-40a9-ac24-90f17fd05562, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:38:28.423415 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Network cc412065-ef9d-40a9-ac24-90f17fd05562 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:38:28.436356 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, cc412065-ef9d-40a9-ac24-90f17fd05562) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:38:28.447105 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca626e58-e857-4f48-a2fd-79385bd9e5fa None None] Network cc412065-ef9d-40a9-ac24-90f17fd05562 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:38:28.450932 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:28.451570 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:28.476257 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-a57f36fe-71db-41b2-8fe8-477707ee1e0f admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.0385060
May 25 16:38:28.599243 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-067b21c7-7948-4e18-b6cb-e8ae7d00519e req-6f85ab0d-8d6f-4728-ae72-9e05d052c9bf tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:28.601287 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-067b21c7-7948-4e18-b6cb-e8ae7d00519e req-6f85ab0d-8d6f-4728-ae72-9e05d052c9bf tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 945 time: 0.1604950
May 25 16:38:28.621227 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-929c7121-6de9-4f33-aebc-0e57ae758adb req-3721625b-f58d-4ac3-a74c-d694c9b683cc tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:28.633129 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-929c7121-6de9-4f33-aebc-0e57ae758adb req-3721625b-f58d-4ac3-a74c-d694c9b683cc tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.76 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 946 time: 0.2775066
May 25 16:38:28.734403 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4baed92-cfde-499e-8657-5de4cef8c9f6 None None] Network cc412065-ef9d-40a9-ac24-90f17fd05562 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:38:28.801376 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-067b21c7-7948-4e18-b6cb-e8ae7d00519e req-ab8dd23a-2cbc-4879-824e-9368b59152e5 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1669567
May 25 16:38:28.952522 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-929c7121-6de9-4f33-aebc-0e57ae758adb req-e08af28c-8f7a-4f5b-9b04-fe69587ab548 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Deleting port d6963172-fb53-4ee4-95ea-1609b9d40db4 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:38:28.955630 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-929c7121-6de9-4f33-aebc-0e57ae758adb req-e08af28c-8f7a-4f5b-9b04-fe69587ab548 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:29.217701 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device dc96a24c-e6ea-4174-9a11-ac0ae925b8fb up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:38:29.558755 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:38:29.562724 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-929c7121-6de9-4f33-aebc-0e57ae758adb req-e08af28c-8f7a-4f5b-9b04-fe69587ab548 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] For port d6963172-fb53-4ee4-95ea-1609b9d40db4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=d6963172-fb53-4ee4-95ea-1609b9d40db4,segment=NetworkSegment(b1e2e8a0-c79b-42fe-a4d3-171a8ed15717),segment_id=b1e2e8a0-c79b-42fe-a4d3-171a8ed15717)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:29.563189 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-929c7121-6de9-4f33-aebc-0e57ae758adb req-e08af28c-8f7a-4f5b-9b04-fe69587ab548 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:29.572517 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:29.573102 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:29.796314 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:29.832899 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=dc96a24c-e6ea-4174-9a11-ac0ae925b8fb,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:29.833953 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31786e99-b18d-4a80-9959-28c18ca63fd3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dc96a24c-e6ea-4174-9a11-ac0ae925b8fb'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:38:29.841542 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:29.843646 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:29.849294 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52934) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:29.854229 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-929c7121-6de9-4f33-aebc-0e57ae758adb req-e08af28c-8f7a-4f5b-9b04-fe69587ab548 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Calling delete_port for d6963172-fb53-4ee4-95ea-1609b9d40db4 owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:38:29.858589 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-36606821-network', 'tenant_id': 'e1b98b7e8e164b4bbfefb9a5c7b29c70'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:29.864256 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:29.870486 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Usage tracker for resource:network and tenant:e1b98b7e8e164b4bbfefb9a5c7b29c70 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:29.874596 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:29.885391 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:29.922276 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Made reservation on behalf of e1b98b7e8e164b4bbfefb9a5c7b29c70 for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:38:29.924838 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:29.938084 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:29.944598 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=dc96a24c-e6ea-4174-9a11-ac0ae925b8fb,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:29.947709 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:29.955382 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:29.959922 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Usage tracker for resource:security_group_rule and tenant:e1b98b7e8e164b4bbfefb9a5c7b29c70 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:29.963174 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:29.969722 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:30.010506 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c3de69b-a553-4dcb-be5d-2e167f392e7c req-53b607c2-111d-45b3-b66b-ea247bec5ebf tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:30.012002 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2c3de69b-a553-4dcb-be5d-2e167f392e7c req-53b607c2-111d-45b3-b66b-ea247bec5ebf tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 946 time: 0.7429538
May 25 16:38:30.073603 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:30.080071 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:30.085654 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2c3de69b-a553-4dcb-be5d-2e167f392e7c req-4b833b93-c1e6-4d3a-a3b5-2e12bb771f58 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/security-groups?id=7890e1c5-3e8a-4733-85ef-97ebc2df58f0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0610151
May 25 16:38:30.093626 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 449}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:38:30.099746 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4410fd7-85a4-4b6e-961b-4a48cb9ac29a req-90f990bf-0e37-4998-aee1-ce92c06ccb7b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:30.101831 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d4410fd7-85a4-4b6e-961b-4a48cb9ac29a req-90f990bf-0e37-4998-aee1-ce92c06ccb7b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.2605031
May 25 16:38:30.105765 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-82bd920a-c7fc-4d13-9a24-a98e7c1078bf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:30.124184 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:30.124184 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Added segment e1d2e5ad-7244-43ce-b33b-a8906034abca of type vlan for network e97a8de0-0444-4c32-af85-7426abc1a726
May 25 16:38:30.145565 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aec46b83-bf35-464e-8295-0e4f70d22d73,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:30.160121 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:30.185479 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:30.223228 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:30.225369 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:30.226319 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:30.232774 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c2ba1213-b58c-4bc4-96f3-a95c6f5892cb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:30.234841 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d4410fd7-85a4-4b6e-961b-4a48cb9ac29a req-5eee0fee-b533-45fa-bda7-309108121ec4 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0817177
May 25 16:38:30.243517 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-929c7121-6de9-4f33-aebc-0e57ae758adb req-e08af28c-8f7a-4f5b-9b04-fe69587ab548 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:30.262025 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:30.312399 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '31786e99-b18d-4a80-9959-28c18ca63fd3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dc96a24c-e6ea-4174-9a11-ac0ae925b8fb', 'code': 200}
May 25 16:38:30.354372 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e08af28c-8f7a-4f5b-9b04-fe69587ab548 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Pushing event deleted for resources: {'Port': ['ID=d6963172-fb53-4ee4-95ea-1609b9d40db4,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:30.358412 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 880 time: 0.5066884
May 25 16:38:30.366584 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 52944) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:30.378027 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Request body: {'subnet': {'network_id': 'e97a8de0-0444-4c32-af85-7426abc1a726', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-36606821-subnet', 'tenant_id': 'e1b98b7e8e164b4bbfefb9a5c7b29c70', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:30.382686 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Pushing event updated for resources: {'Network': ['ID=e97a8de0-0444-4c32-af85-7426abc1a726,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:30.385093 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:30.388255 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:30.390859 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Usage tracker for resource:subnet and tenant:e1b98b7e8e164b4bbfefb9a5c7b29c70 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:30.391106 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-e08af28c-8f7a-4f5b-9b04-fe69587ab548 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:30.394473 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network e97a8de0-0444-4c32-af85-7426abc1a726 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:38:30.407540 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:30.420175 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:30.440628 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-929c7121-6de9-4f33-aebc-0e57ae758adb req-e08af28c-8f7a-4f5b-9b04-fe69587ab548 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] No DVR routers for this DVR port d6963172-fb53-4ee4-95ea-1609b9d40db4 on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:38:30.452519 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-929c7121-6de9-4f33-aebc-0e57ae758adb req-e08af28c-8f7a-4f5b-9b04-fe69587ab548 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:30.454716 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Made reservation on behalf of e1b98b7e8e164b4bbfefb9a5c7b29c70 for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:38:30.456548 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '202b7b00-4b4f-4282-b5ca-6e5f51a3a967', 'name': 'network-vif-deleted', 'tag': 'd6963172-fb53-4ee4-95ea-1609b9d40db4'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:38:30.460683 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-697612'] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:30.484554 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-929c7121-6de9-4f33-aebc-0e57ae758adb req-e08af28c-8f7a-4f5b-9b04-fe69587ab548 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.76 "DELETE /v2.0/ports/d6963172-fb53-4ee4-95ea-1609b9d40db4 HTTP/1.1" status: 204  len: 173 time: 1.8454609
May 25 16:38:30.503652 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8562165a-6e23-4e99-9b47-d2f6c6f25079 req-766d11a0-13ae-4abf-b5da-cfc5431719f7 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:30.505479 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8562165a-6e23-4e99-9b47-d2f6c6f25079 req-766d11a0-13ae-4abf-b5da-cfc5431719f7 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 946 time: 0.2077055
May 25 16:38:30.621819 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8562165a-6e23-4e99-9b47-d2f6c6f25079 req-5e1006f8-f356-4ebd-ad78-f41420f71806 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1066220
May 25 16:38:30.724449 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '202b7b00-4b4f-4282-b5ca-6e5f51a3a967', 'name': 'network-vif-deleted', 'tag': 'd6963172-fb53-4ee4-95ea-1609b9d40db4', 'status': 'completed', 'code': 200}
May 25 16:38:30.758033 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f19715e-a3f1-4fd3-921a-c579b6c5670b req-8847bafa-b6d8-429f-81fd-23562c5bfea3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:30.760407 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0f19715e-a3f1-4fd3-921a-c579b6c5670b req-8847bafa-b6d8-429f-81fd-23562c5bfea3 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 1099 time: 0.1764522
May 25 16:38:30.837851 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0f19715e-a3f1-4fd3-921a-c579b6c5670b req-13833e38-d9b9-439a-a353-ad1df63101bc service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0513515
May 25 16:38:30.963966 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7721570', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-697626'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:30.968925 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:31.044332 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Pushing event updated for resources: {'Subnet': ['ID=f07ab07b-d471-47cd-8aa9-49f475e6d5e6,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:31.048195 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:31.057227 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Checking segment: {'id': 'e1d2e5ad-7244-43ce-b33b-a8906034abca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'e97a8de0-0444-4c32-af85-7426abc1a726'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:38:31.057995 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Network hostable DHCP agents. Network: e97a8de0-0444-4c32-af85-7426abc1a726, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:38:31.079406 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Network e97a8de0-0444-4c32-af85-7426abc1a726 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:38:31.094633 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, e97a8de0-0444-4c32-af85-7426abc1a726) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:38:31.104606 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fae48f74-d895-4b54-be95-b353216fca6b None None] Network e97a8de0-0444-4c32-af85-7426abc1a726 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:38:31.135120 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:31.135740 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:31.187350 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-db4c2390-7c8d-4d90-a20e-bfda705d915d admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 844 time: 0.8194654
May 25 16:38:31.232315 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device d6963172-fb53-4ee4-95ea-1609b9d40db4 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:38:31.293244 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: d6963172-fb53-4ee4-95ea-1609b9d40db4 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:38:31.293757 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device d6963172-fb53-4ee4-95ea-1609b9d40db4 not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:38:31.401806 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-661ebaf7-2e64-4fdf-b0a1-4ecc7a06a0c5 req-191fd70d-55f2-4501-b4ac-996f4d22b1be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Synchronizing usage tracker for tenant:5d60da5ade5b4981948179f148ef1f56 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:38:31.425603 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-661ebaf7-2e64-4fdf-b0a1-4ecc7a06a0c5 req-191fd70d-55f2-4501-b4ac-996f4d22b1be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Unset dirty status for tenant:5d60da5ade5b4981948179f148ef1f56 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:38:31.427022 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-661ebaf7-2e64-4fdf-b0a1-4ecc7a06a0c5 req-191fd70d-55f2-4501-b4ac-996f4d22b1be tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] 10.222.0.73 "GET /v2.0/ports?device_id=202b7b00-4b4f-4282-b5ca-6e5f51a3a967 HTTP/1.1" status: 200  len: 210 time: 0.1110728
May 25 16:38:31.503544 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a85b1f81-6942-48b2-b1a1-7b81854ba8da None None] Network e97a8de0-0444-4c32-af85-7426abc1a726 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:38:31.541935 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5287710-ace9-4cb8-b256-64195eb147e3 req-2eaa9331-2905-4bdc-94a8-49a2f7dc629d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:31.543443 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c5287710-ace9-4cb8-b256-64195eb147e3 req-2eaa9331-2905-4bdc-94a8-49a2f7dc629d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1155813
May 25 16:38:31.578127 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-da7443d2-6c02-4b06-9e17-ee9767d04657 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:31.603443 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c5287710-ace9-4cb8-b256-64195eb147e3 req-1f81880f-6167-4b8b-ace2-4bda9e8d183d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0533512
May 25 16:38:31.856694 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f624961-ffb8-476b-b474-82dd37aebcf3 req-ff71a4ad-4bf0-4732-b63e-3b20d1a5d38c tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:31.858287 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5f624961-ffb8-476b-b474-82dd37aebcf3 req-ff71a4ad-4bf0-4732-b63e-3b20d1a5d38c tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 946 time: 0.1070287
May 25 16:38:31.917213 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5f624961-ffb8-476b-b474-82dd37aebcf3 req-47545015-1bf6-4537-b0a9-4225c31e09ba tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0533137
May 25 16:38:32.816814 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19726594-5a88-4560-9702-e5a513a60242 req-95b285e5-860d-480d-a487-6fb1c147ff77 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:32.818408 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-19726594-5a88-4560-9702-e5a513a60242 req-95b285e5-860d-480d-a487-6fb1c147ff77 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.0832686
May 25 16:38:32.872566 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-19726594-5a88-4560-9702-e5a513a60242 req-130e61af-1ba6-4bb3-82ff-2ea30d9522e9 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0459592
May 25 16:38:33.114413 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf643272-93f8-4745-b9cc-df6d02ebd80e req-c29c8815-a7cb-4a9e-99b9-3afe268d835e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:33.116374 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bf643272-93f8-4745-b9cc-df6d02ebd80e req-c29c8815-a7cb-4a9e-99b9-3afe268d835e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 946 time: 0.0827758
May 25 16:38:33.159954 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bf643272-93f8-4745-b9cc-df6d02ebd80e req-0e8ec8b8-1552-47bc-aa17-df3b7c056789 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0379572
May 25 16:38:33.833276 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:34.061908 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f83b05f-b48c-4aa1-9da8-8461fd588851 req-f76f9d73-6549-437c-ba02-e1c5362f33cd tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:34.063404 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9f83b05f-b48c-4aa1-9da8-8461fd588851 req-f76f9d73-6549-437c-ba02-e1c5362f33cd tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.0818987
May 25 16:38:34.103225 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-28af699b-ea9d-40d3-9335-cf8448cc4fec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:34.110632 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9f83b05f-b48c-4aa1-9da8-8461fd588851 req-c636bc1c-be22-4964-ae52-422813ecd331 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401697
May 25 16:38:34.410570 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80dcdc26-c4d6-4b60-9e56-f253beb31f07 req-6e6c038c-6de9-46d9-8089-923a620b23d2 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:34.412017 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-80dcdc26-c4d6-4b60-9e56-f253beb31f07 req-6e6c038c-6de9-46d9-8089-923a620b23d2 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 946 time: 0.1453552
May 25 16:38:34.458657 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-80dcdc26-c4d6-4b60-9e56-f253beb31f07 req-167b903c-104f-4f2a-b0fd-d4446e06f0eb tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404325
May 25 16:38:35.028212 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:35.300904 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7180c9e-43e4-4227-8fed-73db15bc900c req-6cc51c97-013c-44ba-9327-80c059beb047 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:35.302284 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b7180c9e-43e4-4227-8fed-73db15bc900c req-6cc51c97-013c-44ba-9327-80c059beb047 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.0811725
May 25 16:38:35.348352 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b7180c9e-43e4-4227-8fed-73db15bc900c req-3a592681-5a6f-4f1e-a06b-23460cd77708 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395708
May 25 16:38:35.700021 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b01bf2b-c341-4f47-a44c-a02e61aee447 req-bb988aa2-61bf-4e35-b378-a85daa886103 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:35.701634 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3b01bf2b-c341-4f47-a44c-a02e61aee447 req-bb988aa2-61bf-4e35-b378-a85daa886103 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 946 time: 0.0936370
May 25 16:38:35.758327 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3b01bf2b-c341-4f47-a44c-a02e61aee447 req-46a8fb82-3495-4321-af0d-b0dc53bb77e2 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0485425
May 25 16:38:36.358246 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53118) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:36.468566 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53130) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:36.548162 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:36.583114 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0a84c563-0b3e-4b91-9fc3-019ca7ec0e12 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:36.599216 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_v2 [None req-6cbd07be-91ae-4e3e-9523-f4f4485619ee admin admin] Deleting subnet b953f31d-4490-4000-b4a7-9a7cdcd546da {{(pid=92012) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:38:36.604457 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6cbd07be-91ae-4e3e-9523-f4f4485619ee admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:36.640373 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-0a84c563-0b3e-4b91-9fc3-019ca7ec0e12 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:36.651603 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-0a84c563-0b3e-4b91-9fc3-019ca7ec0e12 admin admin] Usage tracker for resource:security_group_rule and tenant:aea51775b8134578a50fda532600298b is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:36.656655 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-0a84c563-0b3e-4b91-9fc3-019ca7ec0e12 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:36.665673 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-0a84c563-0b3e-4b91-9fc3-019ca7ec0e12 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:36.672172 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6cbd07be-91ae-4e3e-9523-f4f4485619ee admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-976079'] for subnet, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:36.688160 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-300f80d9-e6cf-4b3b-8c05-bcdf248710a1 req-c25e2b70-7558-4774-9725-0b44afce77b0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:36.689887 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-300f80d9-e6cf-4b3b-8c05-bcdf248710a1 req-c25e2b70-7558-4774-9725-0b44afce77b0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1047597
May 25 16:38:36.746449 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-300f80d9-e6cf-4b3b-8c05-bcdf248710a1 req-e74ed7bf-0adc-461c-99d0-bd68d0cbb704 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0444603
May 25 16:38:36.756788 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6cbd07be-91ae-4e3e-9523-f4f4485619ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:36.947427 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0a84c563-0b3e-4b91-9fc3-019ca7ec0e12 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:36.952907 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0a84c563-0b3e-4b91-9fc3-019ca7ec0e12 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:36.963377 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-57969d3d-d3b0-4467-b93b-a211646d5be8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:37.034741 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-0a84c563-0b3e-4b91-9fc3-019ca7ec0e12 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=aea51775b8134578a50fda532600298b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6673357
May 25 16:38:37.037824 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a84c563-0b3e-4b91-9fc3-019ca7ec0e12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dad28ddf-d697-4a14-815d-28e779e1a896,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:37.038503 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53142) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:37.052945 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0a84c563-0b3e-4b91-9fc3-019ca7ec0e12 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:37.115588 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9be87474-9ec4-462d-a771-8f55bf40f2f8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:37.144719 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9be87474-9ec4-462d-a771-8f55bf40f2f8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:37.203200 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9be87474-9ec4-462d-a771-8f55bf40f2f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:37.208618 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-e9fc5a04-dd59-429c-b589-4782ca0419da admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:37.213025 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6cbd07be-91ae-4e3e-9523-f4f4485619ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7721505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-697619'] for subnet, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:37.221358 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9be87474-9ec4-462d-a771-8f55bf40f2f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dad28ddf-d697-4a14-815d-28e779e1a896,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:37.222692 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f594c2ee-b674-49d6-aaf5-eaea6c09c8f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:37.223995 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9be87474-9ec4-462d-a771-8f55bf40f2f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:37.230778 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9be87474-9ec4-462d-a771-8f55bf40f2f8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:37.243188 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-9be87474-9ec4-462d-a771-8f55bf40f2f8 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/dad28ddf-d697-4a14-815d-28e779e1a896 HTTP/1.1" status: 204  len: 168 time: 0.2017698
May 25 16:38:37.260094 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6cbd07be-91ae-4e3e-9523-f4f4485619ee admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:37.263777 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cbd07be-91ae-4e3e-9523-f4f4485619ee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b953f31d-4490-4000-b4a7-9a7cdcd546da,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:37.268349 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-6cbd07be-91ae-4e3e-9523-f4f4485619ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:37.273667 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-6cbd07be-91ae-4e3e-9523-f4f4485619ee admin admin] 10.222.0.73 "DELETE /v2.0/subnets/b953f31d-4490-4000-b4a7-9a7cdcd546da HTTP/1.1" status: 204  len: 168 time: 0.8035414
May 25 16:38:37.275957 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53150) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:37.428566 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:37.627943 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:37.642860 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346b4c2f40>,) {'filters': {'network_id': ['48fa5bbf-9d42-4b66-8b53-a15b499d3d14']}} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:37.660138 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b4c2f40>, 'b1e2e8a0-c79b-42fe-a4d3-171a8ed15717') {'for_net_delete': True} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:37.660629 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b4c2f40>, 'b1e2e8a0-c79b-42fe-a4d3-171a8ed15717') {} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:37.675846 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-976068'] for segment, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:37.700384 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:37.711238 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] Releasing vlan 416 on physical network physnet1 to pool {{(pid=92012) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:38:37.711882 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7823239'] for segment, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:37.722177 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1085adcf-03d1-4a8b-a58f-bc0ae1489bc9 req-3fa7e74b-aa4d-4b3f-813f-cf7e0393f67a service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0981112
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]: Traceback (most recent call last):
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     timer()
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     cb(*args, **kw)
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     return func(*args, **kwargs)
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     self._notify()
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     self.callback(batched_events)
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     event.method(event)
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     return f(self, *a, **k)
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._get(url).json()
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self.request(url, 'GET', **kwargs)
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:38:37.728619 dv-cinder-786386-6-iscsi neutron-server[92012]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:38:37.816063 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:37.825297 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:37.831547 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:37.853819 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] Pushing event deleted for resources: {'Network': ['ID=48fa5bbf-9d42-4b66-8b53-a15b499d3d14,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:37.862657 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] 10.222.0.73 "DELETE /v2.0/networks/48fa5bbf-9d42-4b66-8b53-a15b499d3d14 HTTP/1.1" status: 204  len: 168 time: 0.5845191
May 25 16:38:37.863762 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:38.054116 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87705c6a-5eee-481f-8420-66ab2575b957 req-d4c7b58c-a219-4082-8f4e-8260e0d42993 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:38.056093 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-87705c6a-5eee-481f-8420-66ab2575b957 req-d4c7b58c-a219-4082-8f4e-8260e0d42993 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1528108
May 25 16:38:38.058380 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1085adcf-03d1-4a8b-a58f-bc0ae1489bc9 req-0f044151-80e8-4fcf-aa3f-ec97b3126900 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:38.059752 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1085adcf-03d1-4a8b-a58f-bc0ae1489bc9 req-0f044151-80e8-4fcf-aa3f-ec97b3126900 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=2441ab18acee4d4c9e276ba69a458348&device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 1098 time: 0.2324426
May 25 16:38:38.130400 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53194) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:38.210384 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-08101faf-f2cd-4426-8543-1055767b5b91 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=5d60da5ade5b4981948179f148ef1f56&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0778520
May 25 16:38:38.211552 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53200) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:38.355167 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a54330b6-7d7a-4e13-a741-844feb378522 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:38.401271 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a54330b6-7d7a-4e13-a741-844feb378522 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:38.432399 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-87705c6a-5eee-481f-8420-66ab2575b957 req-6b460f4e-842c-477a-9edb-22889a608a4a tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3692765
May 25 16:38:38.473108 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a54330b6-7d7a-4e13-a741-844feb378522 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:38.482470 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-90ad430f-8450-4237-8047-899b624573ee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:38.504271 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a54330b6-7d7a-4e13-a741-844feb378522 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7890e1c5-3e8a-4733-85ef-97ebc2df58f0,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:38.509186 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a54330b6-7d7a-4e13-a741-844feb378522 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:38.512973 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a54330b6-7d7a-4e13-a741-844feb378522 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:38.515426 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-a54330b6-7d7a-4e13-a741-844feb378522 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/7890e1c5-3e8a-4733-85ef-97ebc2df58f0 HTTP/1.1" status: 204  len: 168 time: 0.3025854
May 25 16:38:38.604872 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1085adcf-03d1-4a8b-a58f-bc0ae1489bc9 req-c3da043e-e38f-472b-9e16-4c1f27fd864e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:38.606681 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1085adcf-03d1-4a8b-a58f-bc0ae1489bc9 req-c3da043e-e38f-472b-9e16-4c1f27fd864e service neutron] 10.222.0.76 "GET /v2.0/networks?id=e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 200  len: 915 time: 0.5058703
May 25 16:38:38.740775 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1085adcf-03d1-4a8b-a58f-bc0ae1489bc9 req-887a7c3f-fd28-469e-9ac3-b725ef25a3bb service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=39034fee-da76-49d9-a359-2be89ce60575 HTTP/1.1" status: 200  len: 217 time: 0.1228693
May 25 16:38:38.983225 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-4bd61987-b62c-4da6-8db4-3c412113e487 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:38.996207 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-4bd61987-b62c-4da6-8db4-3c412113e487 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/networks?id=e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 200  len: 814 time: 0.3060124
May 25 16:38:39.048462 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-c7f8c1cc-5ef1-44e6-bb3e-29429f065e6f tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/quotas/2441ab18acee4d4c9e276ba69a458348 HTTP/1.1" status: 200  len: 375 time: 0.0502503
May 25 16:38:39.163862 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1085adcf-03d1-4a8b-a58f-bc0ae1489bc9 req-8c406b46-b167-4110-bd71-e316ad4b98a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:39.166428 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1085adcf-03d1-4a8b-a58f-bc0ae1489bc9 req-8c406b46-b167-4110-bd71-e316ad4b98a2 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c4c2aef1-f957-410f-9038-a1d13568aa6e HTTP/1.1" status: 200  len: 854 time: 0.2680044
May 25 16:38:39.252337 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1085adcf-03d1-4a8b-a58f-bc0ae1489bc9 req-5363f7fd-48ab-4695-a0cb-e2dbb2da246d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e55be10d-206c-4bb4-8273-c9b859b11a42&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0698252
May 25 16:38:39.388765 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-1da1a5b2-ef4b-4558-b994-e3b179752ace tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=2441ab18acee4d4c9e276ba69a458348&fields=id HTTP/1.1" status: 200  len: 302 time: 0.3387191
May 25 16:38:39.637818 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1085adcf-03d1-4a8b-a58f-bc0ae1489bc9 req-5b1e4f6a-41e8-453a-8b3c-86d6319dbd14 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3752902
May 25 16:38:39.714119 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-6f5d835b-2f75-4a8c-bb49-2bafdd754d8e service neutron] 10.222.0.73 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3191698
May 25 16:38:40.182774 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53286) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:40.234554 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-4c254c9c-400a-4d09-976c-469ddbb384cd service neutron] 10.222.0.73 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5187979
May 25 16:38:40.284025 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1085adcf-03d1-4a8b-a58f-bc0ae1489bc9 req-a6d4a278-23d0-4438-8ffb-d0100b6b155b service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6336122
May 25 16:38:40.344900 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a18103c-bb3c-426e-82ee-d96eea71f6c6 req-c0fb1e81-d4f6-45b6-9c7c-4205b5343c73 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:40.346480 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6a18103c-bb3c-426e-82ee-d96eea71f6c6 req-c0fb1e81-d4f6-45b6-9c7c-4205b5343c73 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.3739109
May 25 16:38:40.401537 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-network', 'tenant_id': '9c4a08443867402386f8ec58d2615739'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:40.410890 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:40.417166 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Usage tracker for resource:network and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:40.420865 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:40.430350 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:40.459666 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6a18103c-bb3c-426e-82ee-d96eea71f6c6 req-531d6ebf-3c6d-45b1-9fbe-297ac0032aa6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0932701
May 25 16:38:40.471650 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Made reservation on behalf of 9c4a08443867402386f8ec58d2615739 for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:38:40.475327 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:40.497212 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:40.514377 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:40.518900 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Usage tracker for resource:security_group_rule and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:40.522804 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:40.531176 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:40.569830 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53302) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:40.674895 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-947009f1-0d39-4f18-9b6f-05948f00c1da req-b77317b7-4ed8-46b9-94de-aacc59d104c0 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 210 time: 0.1050069
May 25 16:38:40.732197 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:40.749260 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:40.754110 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c9ba412c-05fe-42ac-8e54-94a019bf91aa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:40.796705 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 414}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:38:40.818106 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18de4288-8c13-4a1e-b2a1-2cc28d575a94,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:40.822507 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:40.825484 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:40.825976 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Added segment fc8de9c5-fbec-45ca-854e-a4398e6ac83a of type vlan for network b8cabc9a-0f6f-485c-8020-441b42ac019b
May 25 16:38:40.866035 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:40.908843 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:40.910690 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:40.911600 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:40.920121 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:41.059687 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 890 time: 0.8730302
May 25 16:38:41.060070 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53324) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:41.066076 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Request body: {'subnet': {'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-subnet', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:41.073095 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:41.086156 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Usage tracker for resource:subnet and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:41.089494 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:41.089673 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Pushing event updated for resources: {'Network': ['ID=b8cabc9a-0f6f-485c-8020-441b42ac019b,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:41.096104 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:41.103456 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:41.111750 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network b8cabc9a-0f6f-485c-8020-441b42ac019b details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:38:41.121043 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Made reservation on behalf of 9c4a08443867402386f8ec58d2615739 for: {'subnet': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:38:41.123798 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:41.149694 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c0a67b01-920f-48de-b423-2dadb69b8343 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:41.173578 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c0a67b01-920f-48de-b423-2dadb69b8343 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:41.183430 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c0a67b01-920f-48de-b423-2dadb69b8343 admin admin] Usage tracker for resource:security_group_rule and tenant:22832e8b39714158878282db322e9543 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:41.188315 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c0a67b01-920f-48de-b423-2dadb69b8343 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:41.195791 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c0a67b01-920f-48de-b423-2dadb69b8343 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:41.234620 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:41.308778 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c0a67b01-920f-48de-b423-2dadb69b8343 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:41.314958 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c0a67b01-920f-48de-b423-2dadb69b8343 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:41.323432 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-d0c103f5-62b5-4893-8e0b-8d8a60f16ec5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:41.373173 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c0a67b01-920f-48de-b423-2dadb69b8343 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=22832e8b39714158878282db322e9543&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8018298
May 25 16:38:41.374088 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0a67b01-920f-48de-b423-2dadb69b8343 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=106f44c1-bc2b-41c1-92d2-98a1cd1fe600,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:41.375765 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53328) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:41.377284 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c0a67b01-920f-48de-b423-2dadb69b8343 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:41.519973 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9894814e-755f-45f8-af33-4f163c0db464 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:41.667400 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9894814e-755f-45f8-af33-4f163c0db464 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:41.778566 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-808fb9ea-5e7a-496b-b9e6-6c97bda62f55 req-d18af257-1273-4d13-90b7-0a8b2c9beb5f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:41.780078 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-808fb9ea-5e7a-496b-b9e6-6c97bda62f55 req-d18af257-1273-4d13-90b7-0a8b2c9beb5f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1804440
May 25 16:38:41.798124 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9894814e-755f-45f8-af33-4f163c0db464 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:41.814332 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-1e3a956f-399b-47cb-8940-32ca2352011e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:41.843775 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9894814e-755f-45f8-af33-4f163c0db464 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=106f44c1-bc2b-41c1-92d2-98a1cd1fe600,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:41.846123 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9894814e-755f-45f8-af33-4f163c0db464 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:41.881393 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-808fb9ea-5e7a-496b-b9e6-6c97bda62f55 req-12d00ecf-e48c-49fa-b9ef-b9c817a25ad6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0877235
May 25 16:38:41.883752 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9894814e-755f-45f8-af33-4f163c0db464 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:41.884729 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-9894814e-755f-45f8-af33-4f163c0db464 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/106f44c1-bc2b-41c1-92d2-98a1cd1fe600 HTTP/1.1" status: 204  len: 168 time: 0.5075455
May 25 16:38:41.960997 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852'] for subnet, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:41.966176 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-0cc6f3cb-089b-4612-8273-0e2ae760cb4c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:42.070528 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-60573f08-dc8e-41b9-8c42-5617d226afb2 req-ffc5ecd1-b8ca-4f92-9272-b0364e6aae22 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 210 time: 0.0752513
May 25 16:38:42.104123 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Pushing event updated for resources: {'Subnet': ['ID=950695d6-8663-4ed4-92fd-b43d8ea5a820,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:42.110583 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:42.118516 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Checking segment: {'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:38:42.118878 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Network hostable DHCP agents. Network: b8cabc9a-0f6f-485c-8020-441b42ac019b, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92013) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:38:42.140673 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Network b8cabc9a-0f6f-485c-8020-441b42ac019b is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92013) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:38:42.154799 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, b8cabc9a-0f6f-485c-8020-441b42ac019b) {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:38:42.160162 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:42.160758 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.165390 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88722a3b-0a4b-4467-a83f-4469d2e803e7 None None] Network b8cabc9a-0f6f-485c-8020-441b42ac019b requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:38:42.187749 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 853 time: 1.1265125
May 25 16:38:42.190782 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53348) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:42.197594 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:42.203683 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:42.208046 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Usage tracker for resource:router and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:42.212795 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:42.219430 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:42.234911 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-506971', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2375'] for router, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.235961 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-504667', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-501124', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1593705', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2380'] for router, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.258551 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.361323 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53352) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:42.382520 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2a03501b-b6cf-42d8-9fb3-2cefdcc06f9d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.417952 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-2a03501b-b6cf-42d8-9fb3-2cefdcc06f9d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:42.422038 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-2a03501b-b6cf-42d8-9fb3-2cefdcc06f9d admin admin] Usage tracker for resource:security_group_rule and tenant:7fa62736bfb34042b27836ab5d94fb7b is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:42.423096 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d60576c-5158-50e8-99d6-6272b1af5e3f-b8cabc9a-0f6f-485c-8020-441b42ac019b', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820'}]}} from dv-cinder-786386-6-iscsi. {{(pid=92014) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 16:38:42.423999 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.425423 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-2a03501b-b6cf-42d8-9fb3-2cefdcc06f9d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:42.433022 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-2a03501b-b6cf-42d8-9fb3-2cefdcc06f9d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:42.580611 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2a03501b-b6cf-42d8-9fb3-2cefdcc06f9d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.586270 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2a03501b-b6cf-42d8-9fb3-2cefdcc06f9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.587824 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-501153', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-506985', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2362'] for router, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.596469 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:42.631331 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.db_base_plugin_common [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Allocated IP 172.20.0.2 (b8cabc9a-0f6f-485c-8020-441b42ac019b/950695d6-8663-4ed4-92fd-b43d8ea5a820/e868b405-feac-4de5-a5d6-8583b8ddd553) {{(pid=92014) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:38:42.641333 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-2a03501b-b6cf-42d8-9fb3-2cefdcc06f9d admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=7fa62736bfb34042b27836ab5d94fb7b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2784274
May 25 16:38:42.644665 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53358) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:42.695968 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a03501b-b6cf-42d8-9fb3-2cefdcc06f9d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96a85f55-488c-4b0c-888f-2512558fd29a,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:42.725986 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2a03501b-b6cf-42d8-9fb3-2cefdcc06f9d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:42.769441 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-099d91e8-d779-456f-aff9-badf88a0da44 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.831741 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-099d91e8-d779-456f-aff9-badf88a0da44 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.877933 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Notify callbacks [] for port, precommit_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.889867 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Transition to ACTIVE for port object e868b405-feac-4de5-a5d6-8583b8ddd553 will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:38:42.913385 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-099d91e8-d779-456f-aff9-badf88a0da44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.914040 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Transition to ACTIVE for port object e868b405-feac-4de5-a5d6-8583b8ddd553 will not be triggered until provisioned by entity DHCP. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:38:42.921113 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-aa33a34c-efbe-460b-84c4-7a4f630c7001 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:42.921943 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.926308 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:42.936418 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-099d91e8-d779-456f-aff9-badf88a0da44 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96a85f55-488c-4b0c-888f-2512558fd29a,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:42.940641 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-099d91e8-d779-456f-aff9-badf88a0da44 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:42.950572 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-099d91e8-d779-456f-aff9-badf88a0da44 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:42.954023 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-099d91e8-d779-456f-aff9-badf88a0da44 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/96a85f55-488c-4b0c-888f-2512558fd29a HTTP/1.1" status: 204  len: 168 time: 0.3061683
May 25 16:38:43.052349 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Network b8cabc9a-0f6f-485c-8020-441b42ac019b is already hosted by enough agents. {{(pid=92014) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:38:43.061860 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.base_scheduler [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Resources bound (agent type, host, resource id):  {{(pid=92014) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:38:43.065624 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Pushing event updated for resources: {'Port': ['ID=e868b405-feac-4de5-a5d6-8583b8ddd553,revision_number=1']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:43.081331 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Received port after_create {{(pid=92014) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:38:43.087992 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:43.203643 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Attempting to bind port e868b405-feac-4de5-a5d6-8583b8ddd553 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:38:43.205833 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Attempting to bind port e868b405-feac-4de5-a5d6-8583b8ddd553 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:38:43.206698 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Attempting to bind port e868b405-feac-4de5-a5d6-8583b8ddd553 on network b8cabc9a-0f6f-485c-8020-441b42ac019b {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:38:43.217283 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 38, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:38:43.217993 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Checking segment: {'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:38:43.218566 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:43.219415 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Bound using segment: {'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:38:43.220263 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Bound port: e868b405-feac-4de5-a5d6-8583b8ddd553, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:38:43.221180 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:43.223728 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:43.274978 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:43.418566 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f604fafa-5e20-4d8a-b4e3-cd3bc161d88b req-471079ce-86ce-4cae-a74d-11ad19074968 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 210 time: 0.0705183
May 25 16:38:43.479944 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c9ddbed-8e1a-40f1-8923-a901d2bb8bfc req-4fff5d5e-10db-4880-9787-98bc9c19e98d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:43.480120 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] For port e868b405-feac-4de5-a5d6-8583b8ddd553, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:38:43.485341 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] For port e868b405-feac-4de5-a5d6-8583b8ddd553, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=e868b405-feac-4de5-a5d6-8583b8ddd553,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:38:43.490650 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1c9ddbed-8e1a-40f1-8923-a901d2bb8bfc req-4fff5d5e-10db-4880-9787-98bc9c19e98d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.3509221
May 25 16:38:43.495941 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:43.503002 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:43.621271 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1c9ddbed-8e1a-40f1-8923-a901d2bb8bfc req-ddc77490-e055-461f-95b0-79b88a26f329 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1293843
May 25 16:38:43.622467 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Pushing event updated for resources: {'Port': ['ID=e868b405-feac-4de5-a5d6-8583b8ddd553,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:43.628389 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:43.642359 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Allocated IP 172.27.3.132 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/997dcd19-57c4-4c38-a888-8dccf7a26721) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:38:43.859867 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:43.973890 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:44.010136 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:44.167402 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Pushing event updated for resources: {'Port': ['ID=997dcd19-57c4-4c38-a888-8dccf7a26721,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:44.177821 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:44.253026 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:38:44.260425 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:38:44.271617 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:38:44.587587 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-2610f9da-43d5-4e4a-b03f-c8d894bc0ebd tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:44.589101 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-2610f9da-43d5-4e4a-b03f-c8d894bc0ebd tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "GET /v2.0/networks?id=e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 200  len: 814 time: 0.4622736
May 25 16:38:44.618135 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Request body: {'port': {'device_id': '11d77487-53d2-4c41-bad4-58b31f6ad1f9', 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42', 'admin_state_up': True, 'tenant_id': '2441ab18acee4d4c9e276ba69a458348'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:44.906440 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ec9b7a7-8f4a-4864-a1e3-f21c39f9f71d req-297f7d08-a4ef-4eb6-9f67-cdc9715c4375 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:44.909365 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-5ec9b7a7-8f4a-4864-a1e3-f21c39f9f71d req-297f7d08-a4ef-4eb6-9f67-cdc9715c4375 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 1098 time: 0.2132638
May 25 16:38:45.037077 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-5ec9b7a7-8f4a-4864-a1e3-f21c39f9f71d req-0d71fd69-50a9-45b1-8a97-99af0e0ee5bd service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1190159
May 25 16:38:45.040664 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:45.078415 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4ee48be-2e24-49fd-9a8d-9622b77128b0 None None] Network b8cabc9a-0f6f-485c-8020-441b42ac019b requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:38:45.152647 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-33a30d92-7a4c-4a41-8218-8118575d4b82 req-c3601a17-a755-4af4-a384-aee8c0e6d8b8 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 210 time: 0.1218188
May 25 16:38:45.172211 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device e868b405-feac-4de5-a5d6-8583b8ddd553 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:38:45.186566 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:45.329887 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-d4ce1b74-4f3e-43c5-bfff-7963efd8ed47 None None] Provisioning for port e868b405-feac-4de5-a5d6-8583b8ddd553 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:38:45.427643 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port e868b405-feac-4de5-a5d6-8583b8ddd553 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:38:45.454509 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port e868b405-feac-4de5-a5d6-8583b8ddd553 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:45.461355 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:45.517335 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:45.749947 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:45.819295 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Made reservation on behalf of 2441ab18acee4d4c9e276ba69a458348 for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:38:45.822130 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port e868b405-feac-4de5-a5d6-8583b8ddd553, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=e868b405-feac-4de5-a5d6-8583b8ddd553,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:45.822935 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:45.829793 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:45.845265 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.005s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:46.011676 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=e868b405-feac-4de5-a5d6-8583b8ddd553,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:46.019420 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:46.043666 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce8478d-ebf1-41de-b274-19b0d06edb25 req-279190ba-b669-4906-a79c-bb87f20051d9 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:46.051706 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8ce8478d-ebf1-41de-b274-19b0d06edb25 req-279190ba-b669-4906-a79c-bb87f20051d9 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 1.0195699
May 25 16:38:46.184776 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8ce8478d-ebf1-41de-b274-19b0d06edb25 req-0d1e03d6-d497-4c5c-9c8c-40edf51bd847 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1321037
May 25 16:38:46.228153 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-7ff0fb14-a845-4606-9e33-6dd464e6f0ee None None] Provisioning complete for port e868b405-feac-4de5-a5d6-8583b8ddd553 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:46.232310 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7ff0fb14-a845-4606-9e33-6dd464e6f0ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:46.389665 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Allocated IP 172.20.0.7 (e55be10d-206c-4bb4-8273-c9b859b11a42/c4c2aef1-f957-410f-9038-a1d13568aa6e/7b0a5381-d69e-445c-9ee0-f4004f815424) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:38:46.567819 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-506962', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-501218'] for router, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:46.610137 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-83a1adfe-3074-4054-87b7-e3b305bcc2a7 req-368627da-5f0a-4f28-b4e8-9ac029a670f2 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 210 time: 0.1480527
May 25 16:38:46.985143 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device e868b405-feac-4de5-a5d6-8583b8ddd553 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:38:46.986823 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:47.013020 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 is scheduled to L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 with binding_index 1 {{(pid=92013) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 16:38:47.077876 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port e868b405-feac-4de5-a5d6-8583b8ddd553 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:47.078254 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:47.139625 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:47.162590 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['39034fee-da76-49d9-a359-2be89ce60575', 'dc96a24c-e6ea-4174-9a11-ac0ae925b8fb'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:38:47.202963 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:47.529467 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Pushing event updated for resources: {'Port': ['ID=7b0a5381-d69e-445c-9ee0-f4004f815424,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:47.545613 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Network e55be10d-206c-4bb4-8273-c9b859b11a42 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:38:47.546751 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.344s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:47.554690 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:38:47.570151 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:38:47.577580 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:47.578253 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:47.639188 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:38:47.653114 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Sync routers for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:38:47.668459 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:38:47.669115 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b755100>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:38:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:47.692202 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 3.0907774
May 25 16:38:47.694866 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Notify callbacks [] for router, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:47.696243 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] 10.222.0.73 "POST /v2.0/routers HTTP/1.1" status: 201  len: 929 time: 5.5040610
May 25 16:38:47.701952 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53522) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:47.725485 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Request body: {'port': {'device_id': '11d77487-53d2-4c41-bad4-58b31f6ad1f9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:47.824515 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bc043dc-9cae-4439-b8b5-d78c27ca4daf req-4ab038e2-2f63-4917-b489-da18f38f5be3 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:47.828057 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5bc043dc-9cae-4439-b8b5-d78c27ca4daf req-4ab038e2-2f63-4917-b489-da18f38f5be3 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.3771818
May 25 16:38:47.900466 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:38:48.062679 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:48.107708 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5bc043dc-9cae-4439-b8b5-d78c27ca4daf req-3d2f4baa-aa9a-4c7f-89d6-f7360b282f7d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2693167
May 25 16:38:48.217323 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfed5a2c-c79c-483d-982e-f2f4ecfc1cb4 req-1ada0d46-78cc-4342-b5cc-cd22e8552e92 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:48.218636 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-dfed5a2c-c79c-483d-982e-f2f4ecfc1cb4 req-1ada0d46-78cc-4342-b5cc-cd22e8552e92 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Synchronizing usage tracker for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:38:48.322920 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b755100>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:45Z', 'revision_number': 3, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:48.328614 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Checking router: c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:38:48.328981 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Updating router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 port 997dcd19-57c4-4c38-a888-8dccf7a26721 binding host dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:38:48.385054 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:48.443738 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-dfed5a2c-c79c-483d-982e-f2f4ecfc1cb4 req-1ada0d46-78cc-4342-b5cc-cd22e8552e92 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Unset dirty status for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:38:48.451676 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dfed5a2c-c79c-483d-982e-f2f4ecfc1cb4 req-1ada0d46-78cc-4342-b5cc-cd22e8552e92 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 931 time: 0.5568390
May 25 16:38:48.632678 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dfed5a2c-c79c-483d-982e-f2f4ecfc1cb4 req-3e57d1c3-194b-4fb1-9286-4903ef105051 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1798184
May 25 16:38:48.817097 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7b0a5381-d69e-445c-9ee0-f4004f815424 {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:38:48.849971 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:48.863137 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-610867b2-dac8-4e82-8c45-81000464551e req-555a52f5-3bad-44b9-be90-513675ed3bae tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:48.864734 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-610867b2-dac8-4e82-8c45-81000464551e req-555a52f5-3bad-44b9-be90-513675ed3bae tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.3694069
May 25 16:38:48.930482 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Transition to ACTIVE for port object 7b0a5381-d69e-445c-9ee0-f4004f815424 will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:38:48.958141 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:48.969508 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:48.973724 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-25792deb-868c-464d-979e-3d0c731c54d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:49.000909 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Notify callbacks [] for port, precommit_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:49.023850 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.provisioning_blocks [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Transition to ACTIVE for port object 997dcd19-57c4-4c38-a888-8dccf7a26721 will not be triggered until provisioned by entity L2. {{(pid=92015) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:38:49.038264 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:49.063967 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-c3cc46f6-fae3-4772-891a-9fa4b2a9e8cd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:49.128433 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-610867b2-dac8-4e82-8c45-81000464551e req-10e7d113-9290-45c7-be57-63e326436d3f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2541914
May 25 16:38:49.187466 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Pushing event updated for resources: {'Port': ['ID=7b0a5381-d69e-445c-9ee0-f4004f815424,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:49.195388 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Pushing event updated for resources: {'Port': ['ID=997dcd19-57c4-4c38-a888-8dccf7a26721,revision_number=2']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:49.195878 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:49.220197 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Attempting to bind port 7b0a5381-d69e-445c-9ee0-f4004f815424 on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:38:49.221220 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Attempting to bind port 7b0a5381-d69e-445c-9ee0-f4004f815424 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:38:49.221756 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Attempting to bind port 7b0a5381-d69e-445c-9ee0-f4004f815424 on network e55be10d-206c-4bb4-8273-c9b859b11a42 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:38:49.228448 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Port 7b0a5381-d69e-445c-9ee0-f4004f815424 on network e55be10d-206c-4bb4-8273-c9b859b11a42 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:38:49.229031 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Attempting to bind port 7b0a5381-d69e-445c-9ee0-f4004f815424 on network e55be10d-206c-4bb4-8273-c9b859b11a42 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:38:49.234998 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 38, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:38:49.235713 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Checking segment: {'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:38:49.236323 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Bound using segment: {'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:38:49.236988 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Bound port: 7b0a5381-d69e-445c-9ee0-f4004f815424, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:38:49.237182 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:49.237548 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:49.237877 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:49.238204 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:49.238421 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:49.238555 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:49.238830 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:49.239145 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:49.239458 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:49.239859 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:49.240647 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:49.240958 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:49.241267 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:38:49.252616 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Attempting to bind port 997dcd19-57c4-4c38-a888-8dccf7a26721 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:38:49.255913 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Attempting to bind port 997dcd19-57c4-4c38-a888-8dccf7a26721 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:38:49.258269 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Attempting to bind port 997dcd19-57c4-4c38-a888-8dccf7a26721 on network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:38:49.260878 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:49.274843 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 38, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:38:49.275663 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Checking segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92015) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:38:49.276265 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:49.276849 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Bound using segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:38:49.277542 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Bound port: 997dcd19-57c4-4c38-a888-8dccf7a26721, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:38:49.278125 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:49.354852 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Allocated IP 172.20.0.1 (b8cabc9a-0f6f-485c-8020-441b42ac019b/950695d6-8663-4ed4-92fd-b43d8ea5a820/102d0170-5098-4810-8f03-423e54159dd7) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:38:49.430031 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] For port 7b0a5381-d69e-445c-9ee0-f4004f815424, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:38:49.434469 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] For port 997dcd19-57c4-4c38-a888-8dccf7a26721, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92015) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:38:49.434790 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] For port 7b0a5381-d69e-445c-9ee0-f4004f815424, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7b0a5381-d69e-445c-9ee0-f4004f815424,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:38:49.438810 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] For port 997dcd19-57c4-4c38-a888-8dccf7a26721, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=997dcd19-57c4-4c38-a888-8dccf7a26721,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92015) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:38:49.441806 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:49.445701 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:49.448703 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:49.451961 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:49.524154 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:49.525088 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:49.526844 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] 10.222.0.76 "PUT /v2.0/ports/7b0a5381-d69e-445c-9ee0-f4004f815424 HTTP/1.1" status: 200  len: 1093 time: 1.8115647
May 25 16:38:49.529002 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '11d77487-53d2-4c41-bad4-58b31f6ad1f9', 'tag': '7b0a5381-d69e-445c-9ee0-f4004f815424'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:38:49.559271 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Pushing event updated for resources: {'Port': ['ID=7b0a5381-d69e-445c-9ee0-f4004f815424,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:49.562461 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:49.582544 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:38:49.586095 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b755100>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:38:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:49.655934 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '11d77487-53d2-4c41-bad4-58b31f6ad1f9', 'tag': '7b0a5381-d69e-445c-9ee0-f4004f815424', 'status': 'completed', 'code': 200}
May 25 16:38:49.674432 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Pushing event updated for resources: {'Port': ['ID=997dcd19-57c4-4c38-a888-8dccf7a26721,revision_number=3']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:49.689980 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:49.730168 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:49.747018 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Transition to ACTIVE for port object 102d0170-5098-4810-8f03-423e54159dd7 will not be triggered until provisioned by entity DHCP. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:38:49.766341 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-dacbfb3b-67c8-4969-b4d0-6d916089e781 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:49.767784 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-dacbfb3b-67c8-4969-b4d0-6d916089e781 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=2441ab18acee4d4c9e276ba69a458348&device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 1096 time: 0.1794353
May 25 16:38:49.777045 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:49.783647 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:49.872116 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Network b8cabc9a-0f6f-485c-8020-441b42ac019b is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:38:49.875817 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:38:49.877558 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-86ee10ca-ee24-4c9a-bf99-0024a0580d64 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=7b0a5381-d69e-445c-9ee0-f4004f815424 HTTP/1.1" status: 200  len: 217 time: 0.0976918
May 25 16:38:49.881747 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:38:49.910039 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:38:49.931452 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Pushing event updated for resources: {'Port': ['ID=102d0170-5098-4810-8f03-423e54159dd7,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:49.944112 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:49.962317 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-501395'] for router_interface, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:50.061203 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-6a84c128-d105-4c8a-9a85-5e66a57f135f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:50.062781 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-6a84c128-d105-4c8a-9a85-5e66a57f135f service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c4c2aef1-f957-410f-9038-a1d13568aa6e HTTP/1.1" status: 200  len: 854 time: 0.1468194
May 25 16:38:50.130754 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-0b6bc8f8-32c3-4ac7-9b47-ff5ffdac550e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e55be10d-206c-4bb4-8273-c9b859b11a42&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0569878
May 25 16:38:50.154972 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d4bd090-f200-4ea9-bf60-c4e7be411292 req-29276bcd-7ef8-4c69-aaab-4853f0dd2889 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:50.156968 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6d4bd090-f200-4ea9-bf60-c4e7be411292 req-29276bcd-7ef8-4c69-aaab-4853f0dd2889 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 943 time: 0.2782035
May 25 16:38:50.241276 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:50.275786 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-de5a459d-6634-4607-a50e-1cbb14b7c90b None None] Provisioning for port 102d0170-5098-4810-8f03-423e54159dd7 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:38:50.280851 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-de5a459d-6634-4607-a50e-1cbb14b7c90b None None] Provisioning complete for port 102d0170-5098-4810-8f03-423e54159dd7 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:50.281228 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-de5a459d-6634-4607-a50e-1cbb14b7c90b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:50.393205 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-de5a459d-6634-4607-a50e-1cbb14b7c90b None None] Port 102d0170-5098-4810-8f03-423e54159dd7 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:38:50.409457 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6d4bd090-f200-4ea9-bf60-c4e7be411292 req-5cc07f5a-2875-4ea5-96e4-13503ad9bacb tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2142208
May 25 16:38:50.456850 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b755100>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:45Z', 'revision_number': 3, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:50.459624 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-dcf53079-a7e7-4156-9282-f0cbcfda8352 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2990019
May 25 16:38:50.462483 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-992e154e-8f5f-4e0a-926c-a60cc6eebf4a None None] The sync data for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi is: [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:45Z', 'revision_number': 3, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:38:50.614388 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:50.629219 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:50.664185 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-58e30207-e931-492f-9cf1-45595c5db8ee tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:50.767854 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630485', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-501310'] for router_interface, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:50.773723 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Pushing event updated for resources: {'Port': ['ID=102d0170-5098-4810-8f03-423e54159dd7,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:50.788559 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:50.898497 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef34275f-0bb5-4957-b865-d98ca3d448cf req-43fa6e7d-5ea5-4e59-aa5e-70b194509c34 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4325955
May 25 16:38:51.050651 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 997dcd19-57c4-4c38-a888-8dccf7a26721 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:38:51.164059 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Network b8cabc9a-0f6f-485c-8020-441b42ac019b is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:38:51.170986 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:38:51.194393 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6be2d71-d9b9-4cf5-8064-b70fe80770ea req-5e9e0846-abe7-4fd0-877e-bbabd7c675ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:51.196239 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e6be2d71-d9b9-4cf5-8064-b70fe80770ea req-5e9e0846-abe7-4fd0-877e-bbabd7c675ea service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=2441ab18acee4d4c9e276ba69a458348&device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 1096 time: 0.2172883
May 25 16:38:51.211896 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 997dcd19-57c4-4c38-a888-8dccf7a26721 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:38:51.218298 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 997dcd19-57c4-4c38-a888-8dccf7a26721 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:51.218957 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:51.501627 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:51.540676 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6be2d71-d9b9-4cf5-8064-b70fe80770ea req-81115846-1daf-401c-863e-2bd835506e01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:51.543355 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e6be2d71-d9b9-4cf5-8064-b70fe80770ea req-81115846-1daf-401c-863e-2bd835506e01 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 200  len: 915 time: 0.3391597
May 25 16:38:51.583733 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 997dcd19-57c4-4c38-a888-8dccf7a26721, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=997dcd19-57c4-4c38-a888-8dccf7a26721,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:51.598727 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:51.608096 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:51.677077 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-109fcf08-7217-49db-949f-d9092ea26b2c None None] Provisioning complete for port 102d0170-5098-4810-8f03-423e54159dd7 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:51.678461 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-109fcf08-7217-49db-949f-d9092ea26b2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:51.818315 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:38:51.834351 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e6be2d71-d9b9-4cf5-8064-b70fe80770ea req-5a9200b4-96cb-4585-83d9-bff13a0f3069 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=7b0a5381-d69e-445c-9ee0-f4004f815424 HTTP/1.1" status: 200  len: 217 time: 0.2769487
May 25 16:38:51.848566 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-109fcf08-7217-49db-949f-d9092ea26b2c None None] Port 102d0170-5098-4810-8f03-423e54159dd7 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:38:51.895033 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=997dcd19-57c4-4c38-a888-8dccf7a26721,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:51.906251 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.300s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:51.992465 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6be2d71-d9b9-4cf5-8064-b70fe80770ea req-62edadf1-ce40-4a5a-a812-058a410b8a0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:51.994597 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e6be2d71-d9b9-4cf5-8064-b70fe80770ea req-62edadf1-ce40-4a5a-a812-058a410b8a0d service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c4c2aef1-f957-410f-9038-a1d13568aa6e HTTP/1.1" status: 200  len: 854 time: 0.1437373
May 25 16:38:52.003158 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e32bca-a74a-4423-a7c5-367a0040d3d2 req-f24cd338-48d2-47fc-8c31-b3034394da3a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:52.013820 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-25e32bca-a74a-4423-a7c5-367a0040d3d2 req-f24cd338-48d2-47fc-8c31-b3034394da3a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 943 time: 0.3274460
May 25 16:38:52.123286 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-25e32bca-a74a-4423-a7c5-367a0040d3d2 req-dfe93d6e-a867-4ff9-97f0-98ba406ac63c tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1080303
May 25 16:38:52.153059 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e6be2d71-d9b9-4cf5-8064-b70fe80770ea req-75035f02-e086-4ae0-bac6-c9582ebbeeb6 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e55be10d-206c-4bb4-8273-c9b859b11a42&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1081684
May 25 16:38:52.246006 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:38:52.356790 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] 10.222.0.73 "PUT /v2.0/routers/c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.6440918
May 25 16:38:52.387390 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e6be2d71-d9b9-4cf5-8064-b70fe80770ea req-50b9a75e-89bd-4160-9a5d-8f21b535ce45 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2154050
May 25 16:38:52.420439 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44561307-5aee-4434-a226-94e982dcaab5 req-f96786d9-12cd-4404-96e7-759c54ea8d5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:52.422056 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-44561307-5aee-4434-a226-94e982dcaab5 req-f96786d9-12cd-4404-96e7-759c54ea8d5a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fe57668427364ea7acb08a0f7f2826ed&device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 1099 time: 0.1736484
May 25 16:38:52.672110 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e6be2d71-d9b9-4cf5-8064-b70fe80770ea req-3300cfe5-57be-4d66-a0ad-d9fc3dea8c81 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2273607
May 25 16:38:52.700522 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d279e6a2-00f7-4bae-ada1-3a210dfba862 req-50c6f055-3ad6-4f33-8a6f-ad73215057b6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:52.711321 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d279e6a2-00f7-4bae-ada1-3a210dfba862 req-50c6f055-3ad6-4f33-8a6f-ad73215057b6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.3230815
May 25 16:38:52.769823 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d279e6a2-00f7-4bae-ada1-3a210dfba862 req-8567a59d-e73a-4a2c-9b80-99b68ef986fb tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0574973
May 25 16:38:52.785552 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44561307-5aee-4434-a226-94e982dcaab5 req-873995c2-cef7-4bef-8437-4ec26b621f11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:52.787113 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-44561307-5aee-4434-a226-94e982dcaab5 req-873995c2-cef7-4bef-8437-4ec26b621f11 service neutron] 10.222.0.76 "GET /v2.0/networks?id=1186d694-166f-4246-b68b-e7ce60cb0f02 HTTP/1.1" status: 200  len: 918 time: 0.3551393
May 25 16:38:52.903135 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-44561307-5aee-4434-a226-94e982dcaab5 req-72fd59ff-e91a-466b-aff2-9759e63cd1cd service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d HTTP/1.1" status: 200  len: 217 time: 0.1015604
May 25 16:38:52.986185 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44561307-5aee-4434-a226-94e982dcaab5 req-69a9c83c-b01b-4183-87c5-bf79d6448bcb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:52.987949 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-44561307-5aee-4434-a226-94e982dcaab5 req-69a9c83c-b01b-4183-87c5-bf79d6448bcb service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5e6146eb-31ff-437b-a594-8ddb1d63042e HTTP/1.1" status: 200  len: 857 time: 0.0739722
May 25 16:38:52.998377 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 997dcd19-57c4-4c38-a888-8dccf7a26721 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:38:53.085473 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-44561307-5aee-4434-a226-94e982dcaab5 req-cc7d7c8b-6ca1-4597-9165-0294e9cec9ee service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=1186d694-166f-4246-b68b-e7ce60cb0f02&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0856261
May 25 16:38:53.117846 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 997dcd19-57c4-4c38-a888-8dccf7a26721 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:53.118358 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:53.228286 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Sync routers for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:38:53.311537 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:38:53.312471 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b9f7400>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:38:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:53.379662 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-44561307-5aee-4434-a226-94e982dcaab5 req-fea042cb-4ad2-4698-8a59-13f176676c9b service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2887969
May 25 16:38:53.389266 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f33cad-713e-49b4-ba93-9cb83733a8c2 req-084061c5-7f2c-4716-96c5-a2bf1006332e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:53.397682 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a7f33cad-713e-49b4-ba93-9cb83733a8c2 req-084061c5-7f2c-4716-96c5-a2bf1006332e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 943 time: 0.1099238
May 25 16:38:53.431315 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53724) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:53.449114 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1150260300', 'description': 'tempest-description--308184438'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:53.463872 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53728) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:53.474049 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:53.493878 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 7b0a5381-d69e-445c-9ee0-f4004f815424 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:38:53.502139 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a7f33cad-713e-49b4-ba93-9cb83733a8c2 req-08b0e8f6-08b9-4b76-bbb3-10f3fcde0e8e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1029711
May 25 16:38:53.523615 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Usage tracker for resource:security_group and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:53.532004 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:53.552767 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:53.579142 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:53.599714 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-44561307-5aee-4434-a226-94e982dcaab5 req-cfd6e789-fa72-445d-aa32-a269694465cd service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2088926
May 25 16:38:53.618310 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:53.623415 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Usage tracker for resource:security_group_rule and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:53.627808 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:53.635271 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:53.656641 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:38:53.686232 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5639742d-dbcf-437f-9c32-32bda1223bf4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:53.719991 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-5639742d-dbcf-437f-9c32-32bda1223bf4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:53.733010 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-5639742d-dbcf-437f-9c32-32bda1223bf4 admin admin] Usage tracker for resource:security_group_rule and tenant:e946051a03a643cabd69ae30b417c2c4 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:53.737897 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-5639742d-dbcf-437f-9c32-32bda1223bf4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:53.751210 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-5639742d-dbcf-437f-9c32-32bda1223bf4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:53.758605 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:53.765967 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:53.772165 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-cc6a630a-8e49-40c9-9ba1-d681aae001bb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:53.834335 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e55c7544-e1f5-49f7-94eb-8071743f84da,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:53.838013 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:53.838827 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:53.839989 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.4060209
May 25 16:38:53.843272 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53740) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:53.858710 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-d6cc8a42-ab82-47c8-b2b6-b85be6c9fce9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Request body: {'security_group_rule': {'security_group_id': 'e55c7544-e1f5-49f7-94eb-8071743f84da', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:53.866799 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-d6cc8a42-ab82-47c8-b2b6-b85be6c9fce9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:53.884642 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-d6cc8a42-ab82-47c8-b2b6-b85be6c9fce9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Usage tracker for resource:security_group_rule and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:53.892963 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-d6cc8a42-ab82-47c8-b2b6-b85be6c9fce9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:53.905934 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-d6cc8a42-ab82-47c8-b2b6-b85be6c9fce9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:53.941848 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 7b0a5381-d69e-445c-9ee0-f4004f815424, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7b0a5381-d69e-445c-9ee0-f4004f815424,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:53.977428 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '7b0a5381-d69e-445c-9ee0-f4004f815424', 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42', 'port_id': '7b0a5381-d69e-445c-9ee0-f4004f815424', 'mac_address': 'fa:16:3e:f9:e5:70', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 410, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c4c2aef1-f957-410f-9038-a1d13568aa6e', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:38:53.985498 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5639742d-dbcf-437f-9c32-32bda1223bf4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:53.996415 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5639742d-dbcf-437f-9c32-32bda1223bf4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.005059 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-95a9b66f-676c-4c30-ba3f-d1a4a4cf9456 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:54.019431 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d6cc8a42-ab82-47c8-b2b6-b85be6c9fce9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.065382 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1778e40-5f37-4687-9183-104988108d42 req-9ba845ca-e3bd-4f3b-9bb2-d639c5e0c957 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:54.072383 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a1778e40-5f37-4687-9183-104988108d42 req-9ba845ca-e3bd-4f3b-9bb2-d639c5e0c957 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1683424
May 25 16:38:54.087546 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5639742d-dbcf-437f-9c32-32bda1223bf4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1afb20c-7e08-4434-9e30-9afae487d639,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:54.091415 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-5639742d-dbcf-437f-9c32-32bda1223bf4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:54.092166 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.095756 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-5639742d-dbcf-437f-9c32-32bda1223bf4 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=e946051a03a643cabd69ae30b417c2c4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6238396
May 25 16:38:54.099702 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53750) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:54.125718 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7b0a5381-d69e-445c-9ee0-f4004f815424 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:38:54.152530 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 7b0a5381-d69e-445c-9ee0-f4004f815424, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7b0a5381-d69e-445c-9ee0-f4004f815424,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:54.168043 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.174927 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-0d96bae7-f075-497a-bc88-6c125e46ad32 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:54.183507 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d6cc8a42-ab82-47c8-b2b6-b85be6c9fce9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.186095 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a1778e40-5f37-4687-9183-104988108d42 req-95ea3b64-ef3a-43e7-8b97-1ac1d42008f9 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1127775
May 25 16:38:54.202300 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d6cc8a42-ab82-47c8-b2b6-b85be6c9fce9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.205275 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:54.218967 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b9f7400>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 2, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:54.233697 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6cc8a42-ab82-47c8-b2b6-b85be6c9fce9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f8d12419-1457-4746-aa23-bf3d7421e928,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:54.243348 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-64072a9e-d735-4d03-865e-4bcb29c533b5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.250096 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-d6cc8a42-ab82-47c8-b2b6-b85be6c9fce9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:54.253662 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Checking router: c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:38:54.254230 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Updating router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 port 102d0170-5098-4810-8f03-423e54159dd7 binding host dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:38:54.261139 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d6cc8a42-ab82-47c8-b2b6-b85be6c9fce9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.263164 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-d6cc8a42-ab82-47c8-b2b6-b85be6c9fce9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4189181
May 25 16:38:54.266095 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53760) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:54.271838 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-22ad6ad0-87f0-403e-bb3a-aabe35a5c285 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Request body: {'security_group_rule': {'security_group_id': 'e55c7544-e1f5-49f7-94eb-8071743f84da', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:54.278817 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-22ad6ad0-87f0-403e-bb3a-aabe35a5c285 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:54.290943 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-64072a9e-d735-4d03-865e-4bcb29c533b5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.296359 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-22ad6ad0-87f0-403e-bb3a-aabe35a5c285 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Usage tracker for resource:security_group_rule and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:54.300721 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-22ad6ad0-87f0-403e-bb3a-aabe35a5c285 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:54.311631 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-22ad6ad0-87f0-403e-bb3a-aabe35a5c285 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:54.338936 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=7b0a5381-d69e-445c-9ee0-f4004f815424,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:54.347778 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-22ad6ad0-87f0-403e-bb3a-aabe35a5c285 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.355509 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:54.396619 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-64072a9e-d735-4d03-865e-4bcb29c533b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.401652 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-7678179e-a580-49af-8024-e880bd9a9624 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:54.420547 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-64072a9e-d735-4d03-865e-4bcb29c533b5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.424302 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-64072a9e-d735-4d03-865e-4bcb29c533b5 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/d1afb20c-7e08-4434-9e30-9afae487d639 HTTP/1.1" status: 204  len: 168 time: 0.3210814
May 25 16:38:54.424302 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64072a9e-d735-4d03-865e-4bcb29c533b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1afb20c-7e08-4434-9e30-9afae487d639,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:54.424551 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.431902 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-64072a9e-d735-4d03-865e-4bcb29c533b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:54.455268 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-22ad6ad0-87f0-403e-bb3a-aabe35a5c285 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.461680 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-22ad6ad0-87f0-403e-bb3a-aabe35a5c285 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.464328 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:54.488094 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22ad6ad0-87f0-403e-bb3a-aabe35a5c285 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b7209f39-228b-4e93-bf2e-570b1f8f353c,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:54.491181 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-22ad6ad0-87f0-403e-bb3a-aabe35a5c285 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:54.508776 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-22ad6ad0-87f0-403e-bb3a-aabe35a5c285 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.514203 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-22ad6ad0-87f0-403e-bb3a-aabe35a5c285 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2438772
May 25 16:38:54.514574 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53772) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:54.522764 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Request body: {'floatingip': {'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:54.528799 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:54.532670 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Usage tracker for resource:floatingip and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:54.535617 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:54.542771 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:54.566127 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:54.567481 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['7b0a5381-d69e-445c-9ee0-f4004f815424'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:38:54.862620 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:55.023517 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53788) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:55.079722 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36889d0-f9ba-4271-b41c-2b5deeb64b33 req-2aa793ff-19b2-42f6-9f6b-7f78be8ca0c8 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:55.082039 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e36889d0-f9ba-4271-b41c-2b5deeb64b33 req-2aa793ff-19b2-42f6-9f6b-7f78be8ca0c8 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 944 time: 0.2195489
May 25 16:38:55.170768 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Allocated IP 172.27.3.100 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/f01dd4a7-f96a-43b1-ae66-ddeeffbc7586) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:38:55.232758 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Notify callbacks [] for port, precommit_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:55.252767 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Transition to ACTIVE for port object 102d0170-5098-4810-8f03-423e54159dd7 will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:38:55.258906 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53796) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:55.275947 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:55.301929 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:55.302835 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e36889d0-f9ba-4271-b41c-2b5deeb64b33 req-0123a4ad-fcd5-4716-9f06-a0df6ea74e8e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2141933
May 25 16:38:55.303711 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6c89637e-bbee-4f13-b926-aa7b1bf2ef47 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:55.345782 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-6c89637e-bbee-4f13-b926-aa7b1bf2ef47 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:55.348753 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-6c89637e-bbee-4f13-b926-aa7b1bf2ef47 admin admin] Usage tracker for resource:security_group_rule and tenant:5df540b4db46490cacac872dc1a92776 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:55.354074 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-6c89637e-bbee-4f13-b926-aa7b1bf2ef47 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:55.371313 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-6c89637e-bbee-4f13-b926-aa7b1bf2ef47 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:55.600065 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:55.614107 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6c89637e-bbee-4f13-b926-aa7b1bf2ef47 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:55.652933 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad0ac55-b281-464d-8710-77d450534544 req-e31e4fbf-a0f6-4281-a643-82e23bb1c17d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:55.667192 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9ad0ac55-b281-464d-8710-77d450534544 req-e31e4fbf-a0f6-4281-a643-82e23bb1c17d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.2286353
May 25 16:38:55.668477 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:55.670751 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6c89637e-bbee-4f13-b926-aa7b1bf2ef47 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:55.683393 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:55.690386 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9be87474-9ec4-462d-a771-8f55bf40f2f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:55.703422 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-556cdb4e-1769-4536-aeec-20bd3dee85e4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:55.752881 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:38:55.761665 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:38:55.764532 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:38:55.782816 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-556cdb4e-1769-4536-aeec-20bd3dee85e4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:55.793611 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-6c89637e-bbee-4f13-b926-aa7b1bf2ef47 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=5df540b4db46490cacac872dc1a92776&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5312517
May 25 16:38:55.793611 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c89637e-bbee-4f13-b926-aa7b1bf2ef47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e50a1a74-18e0-4750-a5e2-5e973209a2db,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:55.802272 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53808) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:55.803228 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6c89637e-bbee-4f13-b926-aa7b1bf2ef47 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:55.804212 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-556cdb4e-1769-4536-aeec-20bd3dee85e4 admin admin] Usage tracker for resource:security_group_rule and tenant:fb09b9d3b05e41faab6bf29c8e611d19 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:55.820067 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-556cdb4e-1769-4536-aeec-20bd3dee85e4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:55.827679 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42c7215-2a2c-4b61-8661-27e8ff6bf5d2 None None] Pushing event updated for resources: {'Port': ['ID=102d0170-5098-4810-8f03-423e54159dd7,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:55.833246 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-556cdb4e-1769-4536-aeec-20bd3dee85e4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:55.850784 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c42c7215-2a2c-4b61-8661-27e8ff6bf5d2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.549s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:55.869287 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event updated for resources: {'Port': ['ID=f01dd4a7-f96a-43b1-ae66-ddeeffbc7586,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:55.870484 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9ad0ac55-b281-464d-8710-77d450534544 req-8f32ae6e-278d-4e80-b955-41d541ecb8a0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1883826
May 25 16:38:55.872562 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:55.996560 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.014993 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-529d749c-81d0-462d-9fcb-82010f9d375a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.027494 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Attempting to bind port 102d0170-5098-4810-8f03-423e54159dd7 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:38:56.027494 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Attempting to bind port 102d0170-5098-4810-8f03-423e54159dd7 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:38:56.027494 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Attempting to bind port 102d0170-5098-4810-8f03-423e54159dd7 on network b8cabc9a-0f6f-485c-8020-441b42ac019b {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:38:56.037583 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 38, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:38:56.037973 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Checking segment: {'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:38:56.038434 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.038837 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Bound using segment: {'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:38:56.039509 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Bound port: 102d0170-5098-4810-8f03-423e54159dd7, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:38:56.040107 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.102601 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.105645 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-529d749c-81d0-462d-9fcb-82010f9d375a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.165082 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] For port 102d0170-5098-4810-8f03-423e54159dd7, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:38:56.170610 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] For port 102d0170-5098-4810-8f03-423e54159dd7, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=102d0170-5098-4810-8f03-423e54159dd7,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:38:56.181204 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.188273 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:56.204316 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-556cdb4e-1769-4536-aeec-20bd3dee85e4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.210540 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-556cdb4e-1769-4536-aeec-20bd3dee85e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.220560 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-7cc40df3-dbd7-4bf2-9bbc-4f0530d0a942 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:56.271739 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-529d749c-81d0-462d-9fcb-82010f9d375a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.281081 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-556cdb4e-1769-4536-aeec-20bd3dee85e4 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=fb09b9d3b05e41faab6bf29c8e611d19&name=default HTTP/1.1" status: 200  len: 2979 time: 1.2509527
May 25 16:38:56.284877 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-556cdb4e-1769-4536-aeec-20bd3dee85e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c96cd754-c7ff-411c-83e3-d1cafe2fb7c8,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:56.289558 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-556cdb4e-1769-4536-aeec-20bd3dee85e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:56.290724 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:38:56.291458 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53818) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:56.291620 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b9f7400>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:38:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:56.291846 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9894814e-755f-45f8-af33-4f163c0db464 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.014s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:56.368826 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-529d749c-81d0-462d-9fcb-82010f9d375a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e50a1a74-18e0-4750-a5e2-5e973209a2db,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:56.379070 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-529d749c-81d0-462d-9fcb-82010f9d375a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:56.401582 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-529d749c-81d0-462d-9fcb-82010f9d375a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.403368 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-529d749c-81d0-462d-9fcb-82010f9d375a admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/e50a1a74-18e0-4750-a5e2-5e973209a2db HTTP/1.1" status: 204  len: 168 time: 0.5953233
May 25 16:38:56.435683 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42c7215-2a2c-4b61-8661-27e8ff6bf5d2 None None] Pushing event updated for resources: {'Port': ['ID=102d0170-5098-4810-8f03-423e54159dd7,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:56.444829 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c42c7215-2a2c-4b61-8661-27e8ff6bf5d2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:56.460360 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3fb8badf-68fb-42fa-aff5-4ce757f06069 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.503614 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.518261 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.535396 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:56.589348 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3fb8badf-68fb-42fa-aff5-4ce757f06069 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.671527 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:38:56.683487 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event updated for resources: {'Port': ['ID=f01dd4a7-f96a-43b1-ae66-ddeeffbc7586,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:56.687764 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:56.762529 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.796683 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8fed74e-ae0f-413f-bce7-127e59b5ac2a req-adec7b9b-1b3a-4cc1-9334-bdc97b9c5f3a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:56.805894 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e8fed74e-ae0f-413f-bce7-127e59b5ac2a req-adec7b9b-1b3a-4cc1-9334-bdc97b9c5f3a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 944 time: 0.2250826
May 25 16:38:56.822016 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.825163 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 2.3095818
May 25 16:38:56.841548 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3fb8badf-68fb-42fa-aff5-4ce757f06069 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.844439 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-0a13551e-6a8d-4794-8ad7-b4903e1e73d1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:56.869786 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fb8badf-68fb-42fa-aff5-4ce757f06069 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c96cd754-c7ff-411c-83e3-d1cafe2fb7c8,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:56.873566 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-3fb8badf-68fb-42fa-aff5-4ce757f06069 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:56.885918 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3fb8badf-68fb-42fa-aff5-4ce757f06069 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:56.887236 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-3fb8badf-68fb-42fa-aff5-4ce757f06069 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/c96cd754-c7ff-411c-83e3-d1cafe2fb7c8 HTTP/1.1" status: 204  len: 168 time: 0.5874128
May 25 16:38:56.918588 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e8fed74e-ae0f-413f-bce7-127e59b5ac2a req-84874850-a875-49c7-ba63-f9b7eb83346b tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1106780
May 25 16:38:57.057853 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53838) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:57.088309 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6f653342-740d-4a6c-ac44-6de85a0c5bbe admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:57.108513 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-6f653342-740d-4a6c-ac44-6de85a0c5bbe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:57.113104 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-6f653342-740d-4a6c-ac44-6de85a0c5bbe admin admin] Usage tracker for resource:security_group_rule and tenant:d07c4646eece430eb64178d4fbfbb45d is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:57.116068 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-6f653342-740d-4a6c-ac44-6de85a0c5bbe admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:57.122240 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-6f653342-740d-4a6c-ac44-6de85a0c5bbe admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:57.141475 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b9f7400>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:56Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:57.151486 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5c349cf-90f8-42f1-b0d1-314e3047b759 None None] The sync data for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi is: [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:56Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:38:57.264681 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd05277-5dba-43e7-bc6a-ed4ffd354e51 req-6975400b-04f8-40cd-b05d-ee32a33346ff tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:57.266357 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cfd05277-5dba-43e7-bc6a-ed4ffd354e51 req-6975400b-04f8-40cd-b05d-ee32a33346ff tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.2418945
May 25 16:38:57.328283 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 7b0a5381-d69e-445c-9ee0-f4004f815424 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:38:57.373970 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6f653342-740d-4a6c-ac44-6de85a0c5bbe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:57.392785 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6f653342-740d-4a6c-ac44-6de85a0c5bbe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:57.401182 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cfd05277-5dba-43e7-bc6a-ed4ffd354e51 req-2d95452c-6e09-47ff-b37e-decc855dcb25 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1267402
May 25 16:38:57.413281 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-6b5deabc-3212-4ca7-823d-104e12850a42 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:57.476337 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c3d86096-b4a1-483b-8928-9051e4d26dd6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Synchronizing usage tracker for tenant:9c4a08443867402386f8ec58d2615739 on resource:security_group {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:38:57.487208 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-6f653342-740d-4a6c-ac44-6de85a0c5bbe admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=d07c4646eece430eb64178d4fbfbb45d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4277833
May 25 16:38:57.487763 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53860) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:57.491761 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f653342-740d-4a6c-ac44-6de85a0c5bbe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8754792-f993-4c51-ace6-1ef31ae0739d,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:57.533554 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c3d86096-b4a1-483b-8928-9051e4d26dd6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Unset dirty status for tenant:9c4a08443867402386f8ec58d2615739 on resource:security_group {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:38:57.540347 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-6f653342-740d-4a6c-ac44-6de85a0c5bbe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:57.544724 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c3d86096-b4a1-483b-8928-9051e4d26dd6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?name=tempest-securitygroup--1150260300&fields=id&tenant_id=9c4a08443867402386f8ec58d2615739 HTTP/1.1" status: 200  len: 267 time: 0.2348027
May 25 16:38:57.555999 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 7b0a5381-d69e-445c-9ee0-f4004f815424 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:38:57.595926 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-baaab411-239c-41bb-9ec8-61164944c680 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:57.598831 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 7b0a5381-d69e-445c-9ee0-f4004f815424 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:57.599502 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:57.643166 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-baaab411-239c-41bb-9ec8-61164944c680 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:57.793900 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-baaab411-239c-41bb-9ec8-61164944c680 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:57.804052 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-469ed7dd-3103-463e-a414-a16a13d93652 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:57.836138 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baaab411-239c-41bb-9ec8-61164944c680 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8754792-f993-4c51-ace6-1ef31ae0739d,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:57.846188 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-baaab411-239c-41bb-9ec8-61164944c680 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:57.847196 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-baaab411-239c-41bb-9ec8-61164944c680 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:57.854727 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-baaab411-239c-41bb-9ec8-61164944c680 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/d8754792-f993-4c51-ace6-1ef31ae0739d HTTP/1.1" status: 204  len: 168 time: 0.3650267
May 25 16:38:57.872059 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53872) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:57.914658 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:57.914912 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-a37142f8-b96e-4134-b608-5f77ad58e213 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:57.921296 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-a37142f8-b96e-4134-b608-5f77ad58e213 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/networks?id=b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 200  len: 817 time: 0.3735318
May 25 16:38:57.954075 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-5af688ce-bb80-451f-8ffe-5cb3c4937b69 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/quotas/9c4a08443867402386f8ec58d2615739 HTTP/1.1" status: 200  len: 375 time: 0.0316455
May 25 16:38:57.996562 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '11d77487-53d2-4c41-bad4-58b31f6ad1f9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7b0a5381-d69e-445c-9ee0-f4004f815424'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:38:58.009836 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53878) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:58.014639 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 7b0a5381-d69e-445c-9ee0-f4004f815424, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7b0a5381-d69e-445c-9ee0-f4004f815424,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:58.019891 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:58.026670 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_v2 [None req-fdbfcb4e-28c5-4313-b768-1e9aa7eb48ec admin admin] Deleting subnet 06070c87-31bb-4f80-a9d7-4df17bf0a9e0 {{(pid=92012) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:38:58.026984 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:58.031854 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fdbfcb4e-28c5-4313-b768-1e9aa7eb48ec admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:58.071726 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-23a0c10d-279b-4164-9794-12efa6c39c75 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:58.101821 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-23a0c10d-279b-4164-9794-12efa6c39c75 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:38:58.110849 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-23a0c10d-279b-4164-9794-12efa6c39c75 admin admin] Usage tracker for resource:security_group_rule and tenant:29b6887f5c9a466598dacb2f0860a7d2 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:38:58.116748 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-23a0c10d-279b-4164-9794-12efa6c39c75 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:38:58.124668 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=7b0a5381-d69e-445c-9ee0-f4004f815424,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:58.130429 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-23a0c10d-279b-4164-9794-12efa6c39c75 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:38:58.143735 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:58.163186 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-067c23a7-4c0d-4428-9c1f-41f2ac2d6ce7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=9c4a08443867402386f8ec58d2615739&fields=id HTTP/1.1" status: 200  len: 348 time: 0.2081206
May 25 16:38:58.167718 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fdbfcb4e-28c5-4313-b768-1e9aa7eb48ec admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-976079'] for subnet, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:58.243662 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fdbfcb4e-28c5-4313-b768-1e9aa7eb48ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:58.434016 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-815f9e9c-c04d-4714-b378-a5bee6ff5076 service neutron] 10.222.0.73 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2633858
May 25 16:38:58.488021 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cc0f52b-319d-456a-9605-3434f752cfb8 req-4bde975e-0e7d-40c6-acc7-dea4f782e526 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:58.489455 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0cc0f52b-319d-456a-9605-3434f752cfb8 req-4bde975e-0e7d-40c6-acc7-dea4f782e526 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 945 time: 0.2303393
May 25 16:38:58.552083 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-23a0c10d-279b-4164-9794-12efa6c39c75 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:58.589958 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fdbfcb4e-28c5-4313-b768-1e9aa7eb48ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7721505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-697619'] for subnet, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:58.591734 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-23a0c10d-279b-4164-9794-12efa6c39c75 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:58.595190 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:58.605519 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ac9c8e0f-723f-459b-837b-d92fb0600ce2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:58.657664 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdbfcb4e-28c5-4313-b768-1e9aa7eb48ec admin admin] Pushing event deleted for resources: {'Subnet': ['ID=06070c87-31bb-4f80-a9d7-4df17bf0a9e0,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:58.666422 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fdbfcb4e-28c5-4313-b768-1e9aa7eb48ec admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:58.670833 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-fdbfcb4e-28c5-4313-b768-1e9aa7eb48ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:58.676364 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-fdbfcb4e-28c5-4313-b768-1e9aa7eb48ec admin admin] 10.222.0.73 "DELETE /v2.0/subnets/06070c87-31bb-4f80-a9d7-4df17bf0a9e0 HTTP/1.1" status: 204  len: 168 time: 0.8032093
May 25 16:38:58.677557 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53898) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:58.685262 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-23a0c10d-279b-4164-9794-12efa6c39c75 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=29b6887f5c9a466598dacb2f0860a7d2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6691866
May 25 16:38:58.693144 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53902) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:58.699323 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0cc0f52b-319d-456a-9605-3434f752cfb8 req-82b65765-e552-4d62-a63a-3bdb226998b8 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1454568
May 25 16:38:58.732342 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23a0c10d-279b-4164-9794-12efa6c39c75 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4795e120-3ad6-46ff-ab73-df11c8f835ce,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:58.736143 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-23a0c10d-279b-4164-9794-12efa6c39c75 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:58.772305 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-41a37211-73eb-4f17-9cc1-53575a61dcf9 service neutron] 10.222.0.73 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3266058
May 25 16:38:58.803087 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '11d77487-53d2-4c41-bad4-58b31f6ad1f9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7b0a5381-d69e-445c-9ee0-f4004f815424', 'code': 200}
May 25 16:38:58.883476 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-98fffef9-6b79-4629-b89d-b91b078f1fab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:58.929738 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:58.985284 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-98fffef9-6b79-4629-b89d-b91b078f1fab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:59.119703 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 102d0170-5098-4810-8f03-423e54159dd7 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:38:59.202906 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd62b3d-7067-4641-ab05-98b79aaac0a5 req-af329bc6-957f-41eb-bb1f-7c199085587d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:59.212267 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9fd62b3d-7067-4641-ab05-98b79aaac0a5 req-af329bc6-957f-41eb-bb1f-7c199085587d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1298175
May 25 16:38:59.237514 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-98fffef9-6b79-4629-b89d-b91b078f1fab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:59.247573 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-86977892-25eb-4277-bd4e-7b11b35a925f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:59.263649 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-98fffef9-6b79-4629-b89d-b91b078f1fab admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:59.267441 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-98fffef9-6b79-4629-b89d-b91b078f1fab admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/4795e120-3ad6-46ff-ab73-df11c8f835ce HTTP/1.1" status: 204  len: 168 time: 0.5668366
May 25 16:38:59.331332 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9fd62b3d-7067-4641-ab05-98b79aaac0a5 req-5f5481d8-d7ed-4d96-9bfc-46247182f8e3 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1190937
May 25 16:38:59.334649 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98fffef9-6b79-4629-b89d-b91b078f1fab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4795e120-3ad6-46ff-ab73-df11c8f835ce,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:59.339626 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-98fffef9-6b79-4629-b89d-b91b078f1fab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:59.365033 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 102d0170-5098-4810-8f03-423e54159dd7 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:38:59.373525 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 102d0170-5098-4810-8f03-423e54159dd7 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:38:59.374132 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:59.497444 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53926) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:59.584718 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:59.590393 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7ab9256b-2ef4-43ad-9de8-2acf0c00a1c6 req-4d4ceb08-d456-4020-b8db-ae50c270a92a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 210 time: 0.2783353
May 25 16:38:59.596829 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:59.634662 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346af135b0>,) {'filters': {'network_id': ['cc412065-ef9d-40a9-ac24-90f17fd05562']}} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:59.660968 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346af135b0>, '752346b3-2fea-4467-bab6-0947b3533e4a') {'for_net_delete': True} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:59.662010 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346af135b0>, '752346b3-2fea-4467-bab6-0947b3533e4a') {} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:38:59.681745 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-976068'] for segment, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:59.709783 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 102d0170-5098-4810-8f03-423e54159dd7, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=102d0170-5098-4810-8f03-423e54159dd7,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:38:59.714881 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93b5d4f6-9e62-451b-a888-e9bb423b2388 req-8d7b0c7b-68f1-4b3f-89be-0ef22b69a38a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:38:59.717118 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-93b5d4f6-9e62-451b-a888-e9bb423b2388 req-8d7b0c7b-68f1-4b3f-89be-0ef22b69a38a service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 1098 time: 0.5524538
May 25 16:38:59.717660 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:59.718859 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:59.720179 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:59.750273 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] Releasing vlan 436 on physical network physnet1 to pool {{(pid=92012) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:38:59.750698 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7823239'] for segment, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]: Traceback (most recent call last):
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     timer()
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     cb(*args, **kw)
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     return func(*args, **kwargs)
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     self._notify()
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     self.callback(batched_events)
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     event.method(event)
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     return f(self, *a, **k)
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._get(url).json()
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self.request(url, 'GET', **kwargs)
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:38:59.769908 dv-cinder-786386-6-iscsi neutron-server[92012]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:38:59.851918 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=102d0170-5098-4810-8f03-423e54159dd7,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:59.872036 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:59.904245 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-93b5d4f6-9e62-451b-a888-e9bb423b2388 req-f247f428-4669-4f41-99fa-064ba1c64003 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1755285
May 25 16:38:59.911993 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:59.922272 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:38:59.926914 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a797aa8e-24de-4bac-89fb-21ab84b97610 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:38:59.966066 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53938) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:38:59.966490 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] 10.222.0.73 "DELETE /v2.0/networks/cc412065-ef9d-40a9-ac24-90f17fd05562 HTTP/1.1" status: 204  len: 168 time: 1.2879343
May 25 16:38:59.967417 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] Pushing event deleted for resources: {'Network': ['ID=cc412065-ef9d-40a9-ac24-90f17fd05562,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:38:59.971424 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:38:59.993699 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-2059093-network', 'tenant_id': '73cf5a2c98e64235b56c6c8b43e872f5'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:38:59.999163 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:00.006700 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Usage tracker for resource:network and tenant:73cf5a2c98e64235b56c6c8b43e872f5 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:00.016361 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:00.030603 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:00.056571 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Made reservation on behalf of 73cf5a2c98e64235b56c6c8b43e872f5 for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:39:00.064360 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.090419 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.119574 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:00.124623 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Usage tracker for resource:security_group_rule and tenant:73cf5a2c98e64235b56c6c8b43e872f5 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:00.128237 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:00.134450 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53942) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:00.137013 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:00.164003 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ffb35855-b3f3-4c08-acfc-73f9ef7c9237 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.167014 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_v2 [None req-3775c3a4-2207-47b7-8db7-d755b86127d8 admin admin] Deleting subnet f07ab07b-d471-47cd-8aa9-49f475e6d5e6 {{(pid=92013) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:39:00.173325 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3775c3a4-2207-47b7-8db7-d755b86127d8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.191720 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-ffb35855-b3f3-4c08-acfc-73f9ef7c9237 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:00.199790 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-ffb35855-b3f3-4c08-acfc-73f9ef7c9237 admin admin] Usage tracker for resource:security_group_rule and tenant:69af9c1470c9451eb85a9a0f22f09514 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:00.203595 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-ffb35855-b3f3-4c08-acfc-73f9ef7c9237 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:00.213800 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-ffb35855-b3f3-4c08-acfc-73f9ef7c9237 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:00.294581 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3775c3a4-2207-47b7-8db7-d755b86127d8 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.306300 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3775c3a4-2207-47b7-8db7-d755b86127d8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.309713 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.319272 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.324988 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-6f653342-740d-4a6c-ac44-6de85a0c5bbe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:00.374999 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 440}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:39:00.406511 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.407071 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Added segment 73d0d26b-c8b0-4163-b874-267f21730cc2 of type vlan for network 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0
May 25 16:39:00.425457 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37f99fe6-9311-4629-b99b-d75270870d12,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:00.443730 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:00.464467 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ffb35855-b3f3-4c08-acfc-73f9ef7c9237 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.472572 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.477313 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ffb35855-b3f3-4c08-acfc-73f9ef7c9237 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.487265 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:00.526653 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35a88615-b53b-4f4f-a890-5ad411748589 req-163bf63d-2d7b-489f-82ed-43cde0ce080d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:00.528450 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-35a88615-b53b-4f4f-a890-5ad411748589 req-163bf63d-2d7b-489f-82ed-43cde0ce080d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 945 time: 0.4967637
May 25 16:39:00.552352 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-ffb35855-b3f3-4c08-acfc-73f9ef7c9237 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=69af9c1470c9451eb85a9a0f22f09514&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4167275
May 25 16:39:00.561122 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 53952) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:00.586543 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffb35855-b3f3-4c08-acfc-73f9ef7c9237 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c49aa58f-6553-4e97-bf11-98f23e5d2175,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:00.591731 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ffb35855-b3f3-4c08-acfc-73f9ef7c9237 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:00.599793 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.603771 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:00.610651 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.611608 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:00.768601 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-35a88615-b53b-4f4f-a890-5ad411748589 req-0b7a6520-6885-47c6-b762-85ae2e70d008 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2255385
May 25 16:39:00.778962 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Pushing event updated for resources: {'Network': ['ID=5782c094-7ba9-4a97-a5bd-3f5f0a0557b0,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:00.783562 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:00.787096 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fa9a4e78-5d23-43a1-b4da-2ea287d126b5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.789548 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 879 time: 1.2916374
May 25 16:39:00.800979 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53958) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:00.801255 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:39:00.815236 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Request body: {'subnet': {'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-2059093-subnet', 'tenant_id': '73cf5a2c98e64235b56c6c8b43e872f5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:00.826529 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:00.834115 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fa9a4e78-5d23-43a1-b4da-2ea287d126b5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.842261 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Usage tracker for resource:subnet and tenant:73cf5a2c98e64235b56c6c8b43e872f5 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:00.847390 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:00.858857 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:00.887002 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e184e647-08fa-48d1-974f-065334847157 req-37884700-9db2-4bd2-a4e4-9a8d8c092fe4 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:00.888919 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e184e647-08fa-48d1-974f-065334847157 req-37884700-9db2-4bd2-a4e4-9a8d8c092fe4 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.3095646
May 25 16:39:00.924476 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3775c3a4-2207-47b7-8db7-d755b86127d8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852'] for subnet, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.930136 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Made reservation on behalf of 73cf5a2c98e64235b56c6c8b43e872f5 for: {'subnet': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:39:00.933319 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Notify callbacks [] for subnet, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.949419 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fa9a4e78-5d23-43a1-b4da-2ea287d126b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:00.954777 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:00.978789 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa9a4e78-5d23-43a1-b4da-2ea287d126b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c49aa58f-6553-4e97-bf11-98f23e5d2175,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:00.981861 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-fa9a4e78-5d23-43a1-b4da-2ea287d126b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:00.990212 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-105c2a5e-58fd-46a8-845b-3afdba5a2869 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:00.999719 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fa9a4e78-5d23-43a1-b4da-2ea287d126b5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:01.004300 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-fa9a4e78-5d23-43a1-b4da-2ea287d126b5 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/c49aa58f-6553-4e97-bf11-98f23e5d2175 HTTP/1.1" status: 204  len: 168 time: 0.4387875
May 25 16:39:01.120297 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 102d0170-5098-4810-8f03-423e54159dd7 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:01.196930 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3775c3a4-2207-47b7-8db7-d755b86127d8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f07ab07b-d471-47cd-8aa9-49f475e6d5e6,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:01.235979 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e04c4074-fb48-4d4b-b74c-2b1659c24be5 req-e1912b3f-cae5-4b7e-9675-ae5f650469cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 210 time: 0.2641563
May 25 16:39:01.243305 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-3775c3a4-2207-47b7-8db7-d755b86127d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.256s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:01.244502 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3775c3a4-2207-47b7-8db7-d755b86127d8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:01.281270 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e184e647-08fa-48d1-974f-065334847157 req-6d3aa47b-7d2a-4c07-bfa4-99e4ff0fc3b0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3854682
May 25 16:39:01.293623 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 102d0170-5098-4810-8f03-423e54159dd7 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:01.294024 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:01.298895 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-3775c3a4-2207-47b7-8db7-d755b86127d8 admin admin] 10.222.0.73 "DELETE /v2.0/subnets/f07ab07b-d471-47cd-8aa9-49f475e6d5e6 HTTP/1.1" status: 204  len: 168 time: 1.3314431
May 25 16:39:01.307323 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 53964) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:01.434818 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-0cd20203-6097-4d41-8319-1f6fad83278c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:01.557552 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:01.655943 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-50fdc3ac-2716-42d5-9a79-73b2353c2c69 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:01.657152 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-50fdc3ac-2716-42d5-9a79-73b2353c2c69 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Synchronizing usage tracker for tenant:9c4a08443867402386f8ec58d2615739 on resource:network {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:39:01.690405 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-50fdc3ac-2716-42d5-9a79-73b2353c2c69 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Unset dirty status for tenant:9c4a08443867402386f8ec58d2615739 on resource:network {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:39:01.692565 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-50fdc3ac-2716-42d5-9a79-73b2353c2c69 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.76 "GET /v2.0/networks?id=b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 200  len: 817 time: 0.4827030
May 25 16:39:01.766581 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-030cfbd5-7991-41a1-ad60-f0c3d53b4fd0 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Synchronizing usage tracker for tenant:9c4a08443867402386f8ec58d2615739 on resource:security_group {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:39:01.786053 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-030cfbd5-7991-41a1-ad60-f0c3d53b4fd0 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Unset dirty status for tenant:9c4a08443867402386f8ec58d2615739 on resource:security_group {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:39:01.790715 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-030cfbd5-7991-41a1-ad60-f0c3d53b4fd0 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9c4a08443867402386f8ec58d2615739 HTTP/1.1" status: 200  len: 380 time: 0.0849497
May 25 16:39:01.817214 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Request body: {'port': {'device_id': 'f193b888-613a-4d01-a738-0c43d97877b4', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'admin_state_up': True, 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'security_groups': ['e55c7544-e1f5-49f7-94eb-8071743f84da']}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:01.819289 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:01.838969 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7f346a446b20>> segment before_delete 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.838969 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7f346a446b20>> subnet precommit_delete_associations 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.839801 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346a446910>> segment_host_mapping after_create 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.840152 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346a446910>> port after_create 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.840476 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346a446910>> port after_delete 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.840830 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346a446910>> port after_update 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.841151 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346a446910>> segment after_delete 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.841495 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346a446910>> subnet after_create 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.841814 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346a446910>> subnet after_delete 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.842133 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f346a446910>> subnet after_update 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.987323 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f346a2419a0>> subnet after_create 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.987741 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f346a2419a0>> subnet after_delete 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.988024 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f346a2419a0>> subnet before_create 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.988386 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f346a2419a0>> subnet before_update 55550000 {{(pid=92013) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 16:39:01.988746 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346a446a90>,) {'filters': {'network_id': ['e97a8de0-0444-4c32-af85-7426abc1a726']}} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:01.994117 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:01.998051 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Usage tracker for resource:port and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:02.000982 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Quota usage for port was recalculated. Used quota:3. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:02.007029 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:02.018017 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Made reservation on behalf of 9c4a08443867402386f8ec58d2615739 for: {'port': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:39:02.021906 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:02.089737 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346a446a90>, 'e1d2e5ad-7244-43ce-b33b-a8906034abca') {'for_net_delete': True} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:02.090102 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346a446a90>, 'e1d2e5ad-7244-43ce-b33b-a8906034abca') {} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:02.121854 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6928871'] for segment, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:02.156982 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:02.168218 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Releasing vlan 449 on physical network physnet1 to pool {{(pid=92013) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:39:02.168632 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7025874'] for segment, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   from cryptography.utils import int_from_bytes
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   from cryptography.utils import int_from_bytes
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]: Traceback (most recent call last):
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     timer()
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     cb(*args, **kw)
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     return func(*args, **kwargs)
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     self._notify()
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     self.callback(batched_events)
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     event.method(event)
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     return f(self, *a, **k)
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self._get(url).json()
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self.request(url, 'GET', **kwargs)
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:39:02.186966 dv-cinder-786386-6-iscsi neutron-server[92013]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:39:02.266645 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Allocated IP 172.20.0.9 (b8cabc9a-0f6f-485c-8020-441b42ac019b/950695d6-8663-4ed4-92fd-b43d8ea5a820/07e04c0f-8286-42fc-96c2-0e366da529c6) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:39:02.294918 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:02.310667 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73565494-8245-44c4-bb95-131226116c32 req-308aecc1-86f1-4224-a4ff-b00f3bb3dfa2 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:02.312094 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-73565494-8245-44c4-bb95-131226116c32 req-308aecc1-86f1-4224-a4ff-b00f3bb3dfa2 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 945 time: 0.2641888
May 25 16:39:02.319284 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:02.338812 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:02.394398 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Pushing event deleted for resources: {'Network': ['ID=e97a8de0-0444-4c32-af85-7426abc1a726,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:02.420272 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:02.429805 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] 10.222.0.73 "DELETE /v2.0/networks/e97a8de0-0444-4c32-af85-7426abc1a726 HTTP/1.1" status: 204  len: 168 time: 1.1189327
May 25 16:39:02.504808 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:39:02.593068 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:02.625546 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Transition to ACTIVE for port object 07e04c0f-8286-42fc-96c2-0e366da529c6 will not be triggered until provisioned by entity DHCP. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:02.646979 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8231de17-1796-4a2c-9325-ebcc8121bfcd req-a6711ea8-1586-4761-9bfe-f1bd0b501d7d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 210 time: 0.2204471
May 25 16:39:02.656461 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-73565494-8245-44c4-bb95-131226116c32 req-bcb5ab60-4003-4117-ac77-9fa1642ec737 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3087068
May 25 16:39:02.692508 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:02.712592 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:02.735075 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 54012) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:02.857880 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6928695', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-7156494'] for subnet, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:02.870456 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:02.903899 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Network b8cabc9a-0f6f-485c-8020-441b42ac019b is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:39:02.909347 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:02.917338 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:39:02.980398 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-81db8c3b-16df-4334-a79e-46bf521fefaa admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=8788479dfd374aaa9b7cd176d29fdf98&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2419121
May 25 16:39:02.994605 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54016) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:03.026829 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event updated for resources: {'Port': ['ID=07e04c0f-8286-42fc-96c2-0e366da529c6,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:03.042564 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.330s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:03.093034 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:03.093768 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:03.111406 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Pushing event updated for resources: {'Subnet': ['ID=4030a70d-20ce-4ddd-ab1c-d1d794468e8e,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:03.117984 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:03.135286 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Checking segment: {'id': '73d0d26b-c8b0-4163-b874-267f21730cc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 440, 'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:39:03.135895 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Network hostable DHCP agents. Network: 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92013) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:39:03.146933 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.3335657
May 25 16:39:03.152920 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ed25b676-4823-444e-bd5d-082d6b599227 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:03.161419 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Request body: {'port': {'device_id': 'f193b888-613a-4d01-a738-0c43d97877b4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:03.179925 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Network 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92013) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:39:03.189504 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-649d8a55-1e4e-4ef5-a1d6-2a5762c657aa req-6859b86b-ecfa-4361-a2ed-d62da7063e1b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:03.191196 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-649d8a55-1e4e-4ef5-a1d6-2a5762c657aa req-6859b86b-ecfa-4361-a2ed-d62da7063e1b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.2312815
May 25 16:39:03.240968 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0) {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:03.254401 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f3bc377-8c17-49a4-b7fa-084365ed9dcb None None] Network 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:39:03.282374 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:03.282969 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] Notify callbacks [] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:03.293780 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-649d8a55-1e4e-4ef5-a1d6-2a5762c657aa req-e6d255bb-d837-4a67-b9f7-e9919e87e6ef tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0782442
May 25 16:39:03.338081 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-5616464a-c750-4939-95a5-c9557715243c admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 843 time: 2.5323713
May 25 16:39:03.373576 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ed25b676-4823-444e-bd5d-082d6b599227 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:03.476578 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:03.486812 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-54afefe1-c13a-40e5-a80a-41f788f0b586 None None] Provisioning for port 07e04c0f-8286-42fc-96c2-0e366da529c6 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:03.502185 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-54afefe1-c13a-40e5-a80a-41f788f0b586 None None] Provisioning complete for port 07e04c0f-8286-42fc-96c2-0e366da529c6 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:03.502812 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-54afefe1-c13a-40e5-a80a-41f788f0b586 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:03.580540 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ed25b676-4823-444e-bd5d-082d6b599227 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:03.587718 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-207752bf-73b5-4d7b-8172-ad50dea29f86 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:03.614969 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed25b676-4823-444e-bd5d-082d6b599227 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92101fac-7cc3-4c34-aa5e-6940de94a166,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:03.619466 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ed25b676-4823-444e-bd5d-082d6b599227 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:03.682902 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ed25b676-4823-444e-bd5d-082d6b599227 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:03.705249 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-ed25b676-4823-444e-bd5d-082d6b599227 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/92101fac-7cc3-4c34-aa5e-6940de94a166 HTTP/1.1" status: 204  len: 168 time: 0.7095094
May 25 16:39:03.827632 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-54afefe1-c13a-40e5-a80a-41f788f0b586 None None] Port 07e04c0f-8286-42fc-96c2-0e366da529c6 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:39:03.878083 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad4eebac-e537-47d1-8607-decd02d05235 None None] Network 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:39:03.988285 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a71cf0-69ca-418a-8266-96d7d6149694 req-c4cd6a7d-c084-401c-9ff7-5fea510c4eea tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:04.000052 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c9a71cf0-69ca-418a-8266-96d7d6149694 req-c4cd6a7d-c084-401c-9ff7-5fea510c4eea tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 931 time: 0.1721096
May 25 16:39:04.024510 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:04.103742 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c9a71cf0-69ca-418a-8266-96d7d6149694 req-c77c4de7-f600-4540-bdc0-3a2bd3f0d237 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1025400
May 25 16:39:04.227776 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 07e04c0f-8286-42fc-96c2-0e366da529c6 {{(pid=92012) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:39:04.241228 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:04.245637 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-3c0b5be1-4d32-493e-aa34-314abe2be0bd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:04.275756 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Transition to ACTIVE for port object 07e04c0f-8286-42fc-96c2-0e366da529c6 will not be triggered until provisioned by entity L2. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:04.286593 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:04.292396 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:04.482842 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Pushing event updated for resources: {'Port': ['ID=07e04c0f-8286-42fc-96c2-0e366da529c6,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:04.486136 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:04.493317 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 54046) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:04.619973 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-1689d6bf-eccd-4ee0-b58a-209f56fcdfca admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=e1b98b7e8e164b4bbfefb9a5c7b29c70&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1250868
May 25 16:39:04.620761 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 54054) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:04.703639 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Attempting to bind port 07e04c0f-8286-42fc-96c2-0e366da529c6 on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:39:04.703639 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Attempting to bind port 07e04c0f-8286-42fc-96c2-0e366da529c6 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'}] {{(pid=92012) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:39:04.703639 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Attempting to bind port 07e04c0f-8286-42fc-96c2-0e366da529c6 on network b8cabc9a-0f6f-485c-8020-441b42ac019b {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:04.716204 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Port 07e04c0f-8286-42fc-96c2-0e366da529c6 on network b8cabc9a-0f6f-485c-8020-441b42ac019b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:39:04.716526 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Attempting to bind port 07e04c0f-8286-42fc-96c2-0e366da529c6 on network b8cabc9a-0f6f-485c-8020-441b42ac019b {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:04.726031 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 38, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:39:04.726368 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Checking segment: {'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:39:04.726750 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Bound using segment: {'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'} {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:39:04.727194 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Bound port: 07e04c0f-8286-42fc-96c2-0e366da529c6, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'}}] {{(pid=92012) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:39:04.727518 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:04.796524 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-f5df4721-660e-48de-87fc-f8dc43fcb34b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:04.847492 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] For port 07e04c0f-8286-42fc-96c2-0e366da529c6, host hv-cinder-78638, cleared binding levels {{(pid=92012) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:39:04.847692 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-f5df4721-660e-48de-87fc-f8dc43fcb34b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:04.861085 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] For port 07e04c0f-8286-42fc-96c2-0e366da529c6, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=07e04c0f-8286-42fc-96c2-0e366da529c6,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92012) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:39:04.875311 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:04.880660 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:04.882541 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc8d941-50d2-4854-8b30-59c3cd3dd7ae req-90d4e4bb-adc7-4ec0-a8d5-01db6cf5ce34 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:04.884092 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9cc8d941-50d2-4854-8b30-59c3cd3dd7ae req-90d4e4bb-adc7-4ec0-a8d5-01db6cf5ce34 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1493361
May 25 16:39:04.955725 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9cc8d941-50d2-4854-8b30-59c3cd3dd7ae req-9ec89b72-8a45-47a5-afb7-15f29bd58bde tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0658293
May 25 16:39:04.958072 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-f5df4721-660e-48de-87fc-f8dc43fcb34b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:04.965570 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6c89637e-bbee-4f13-b926-aa7b1bf2ef47 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:04.969914 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:04.971101 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:04.972807 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] 10.222.0.76 "PUT /v2.0/ports/07e04c0f-8286-42fc-96c2-0e366da529c6 HTTP/1.1" status: 200  len: 1093 time: 1.8164139
May 25 16:39:04.973435 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:39:04.979951 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5df4721-660e-48de-87fc-f8dc43fcb34b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aec46b83-bf35-464e-8295-0e4f70d22d73,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:04.996521 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Pushing event updated for resources: {'Port': ['ID=07e04c0f-8286-42fc-96c2-0e366da529c6,revision_number=3']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:05.001866 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:05.042000 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-f5df4721-660e-48de-87fc-f8dc43fcb34b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:05.055547 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-f5df4721-660e-48de-87fc-f8dc43fcb34b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:05.059357 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-f5df4721-660e-48de-87fc-f8dc43fcb34b admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/aec46b83-bf35-464e-8295-0e4f70d22d73 HTTP/1.1" status: 204  len: 168 time: 0.4346263
May 25 16:39:05.070971 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:05.141811 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'status': 'completed', 'code': 200}
May 25 16:39:05.219029 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-5cd5c06a-e0ab-4ccb-8329-8d3f9863cf47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:05.228023 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-5cd5c06a-e0ab-4ccb-8329-8d3f9863cf47 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9c4a08443867402386f8ec58d2615739&device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 1096 time: 0.1707034
May 25 16:39:05.365016 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-4015a5f8-cbd6-4b24-982a-d612b47866cb service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=07e04c0f-8286-42fc-96c2-0e366da529c6 HTTP/1.1" status: 200  len: 217 time: 0.1264982
May 25 16:39:05.452800 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-f47aaeb7-a9b3-488c-b2ad-6e3967c5a881 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:05.454382 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-f47aaeb7-a9b3-488c-b2ad-6e3967c5a881 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=950695d6-8663-4ed4-92fd-b43d8ea5a820 HTTP/1.1" status: 200  len: 856 time: 0.0810318
May 25 16:39:05.460591 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45754280-b8f1-4098-aae0-3521688d2f46 req-46713890-99d4-496b-9633-6e5b77f79564 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:05.462095 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-45754280-b8f1-4098-aae0-3521688d2f46 req-46713890-99d4-496b-9633-6e5b77f79564 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.1417284
May 25 16:39:05.531689 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-45754280-b8f1-4098-aae0-3521688d2f46 req-7686bf92-4ee1-4115-8275-a8eca4622fec tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0621145
May 25 16:39:05.571372 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-40bfe4b0-fdfd-489f-8703-ec484680622a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:05.573755 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-40bfe4b0-fdfd-489f-8703-ec484680622a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b8cabc9a-0f6f-485c-8020-441b42ac019b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1098638
May 25 16:39:05.791622 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-671f9665-2b16-40b7-858b-89f5ec19fc79 service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2067897
May 25 16:39:06.230750 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2574b365-0515-434f-9ea9-a65757b7451e req-19d434c6-821d-430b-b1f1-8464feaf188f tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:06.232581 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-19d434c6-821d-430b-b1f1-8464feaf188f tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/networks?id=5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 HTTP/1.1" status: 200  len: 806 time: 0.1727440
May 25 16:39:06.259984 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-ec5d0a44-a10c-42ed-838e-7fc797ac5c44 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/quotas/73cf5a2c98e64235b56c6c8b43e872f5 HTTP/1.1" status: 200  len: 375 time: 0.0190423
May 25 16:39:06.335447 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-c3547dd7-b9d2-4682-81c5-42c875e7eb42 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=73cf5a2c98e64235b56c6c8b43e872f5&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0587709
May 25 16:39:06.482008 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-9a45fe48-c071-464d-a88c-083d407700c1 service neutron] 10.222.0.73 "GET /v2.0/networks/5782c094-7ba9-4a97-a5bd-3f5f0a0557b0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1399505
May 25 16:39:06.549882 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:06.631498 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-2d17d010-4fc1-4ade-baec-7bb4c53df79b service neutron] 10.222.0.73 "GET /v2.0/networks/5782c094-7ba9-4a97-a5bd-3f5f0a0557b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1423483
May 25 16:39:06.958909 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dfdd3ad-8a47-4253-af20-4a0dae893797 req-1e0ecf13-cf5d-4123-ba46-c6418b971f9a tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:06.965964 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1dfdd3ad-8a47-4253-af20-4a0dae893797 req-1e0ecf13-cf5d-4123-ba46-c6418b971f9a tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1067944
May 25 16:39:07.028289 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1dfdd3ad-8a47-4253-af20-4a0dae893797 req-fe9f4360-728d-4541-bf2a-97349f45cbd3 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0598509
May 25 16:39:07.251050 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35df11ad-1a0d-48a7-ad20-dd2285ef17b9 req-785abce2-e5ce-4376-be0a-2529481796dd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:07.252802 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-35df11ad-1a0d-48a7-ad20-dd2285ef17b9 req-785abce2-e5ce-4376-be0a-2529481796dd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0962126
May 25 16:39:07.318268 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-35df11ad-1a0d-48a7-ad20-dd2285ef17b9 req-743baf89-4457-4d54-ba08-31206bb9a17d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0577755
May 25 16:39:07.471750 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1bcde9f4-f6a9-4a34-95ca-76aa6af3035c req-cc9e1b51-cbec-4acd-96f9-b29b944e7745 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 210 time: 0.0458984
May 25 16:39:08.228115 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d8fba8c-ecee-4e24-98cd-6607f4d27c7b req-66f1b078-3f51-4032-8bfd-f7a94da57369 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:08.229611 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2d8fba8c-ecee-4e24-98cd-6607f4d27c7b req-66f1b078-3f51-4032-8bfd-f7a94da57369 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0827665
May 25 16:39:08.276619 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2d8fba8c-ecee-4e24-98cd-6607f4d27c7b req-aedf7920-f43f-40e4-8475-3dde6e127093 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388858
May 25 16:39:08.514652 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d068cb53-aa1e-421a-9219-cfdd29c9fde9 req-2222cd66-c222-4bf5-9ff2-c66aa251afef tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:08.516171 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d068cb53-aa1e-421a-9219-cfdd29c9fde9 req-2222cd66-c222-4bf5-9ff2-c66aa251afef tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0868747
May 25 16:39:08.560901 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d068cb53-aa1e-421a-9219-cfdd29c9fde9 req-47a82ddc-f809-46c3-b49c-a28af38a3df5 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0386586
May 25 16:39:08.703409 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-516f237d-24ee-4894-bd13-53d645ad3d3b req-01eb9974-9ef3-4177-ba8e-d2989a892321 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 210 time: 0.0473652
May 25 16:39:09.001269 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7be092ac-281f-4550-93b7-5fec3c2e445f req-b84c3c0d-caf5-4fa2-81c0-e8787e1ebf4c service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1728206
May 25 16:39:09.155164 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f5b672b-bf1b-4fbc-a152-351511d4b0a0 req-1870dc22-ba61-4bfb-affb-1bc77385db5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:09.156778 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7f5b672b-bf1b-4fbc-a152-351511d4b0a0 req-1870dc22-ba61-4bfb-affb-1bc77385db5f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9c4a08443867402386f8ec58d2615739&device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 1096 time: 0.0925627
May 25 16:39:09.389226 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f5b672b-bf1b-4fbc-a152-351511d4b0a0 req-15535304-3a7e-436b-962b-b818d34e2c35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:09.391073 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7f5b672b-bf1b-4fbc-a152-351511d4b0a0 req-15535304-3a7e-436b-962b-b818d34e2c35 service neutron] 10.222.0.76 "GET /v2.0/networks?id=b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 200  len: 918 time: 0.2278740
May 25 16:39:09.462546 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7f5b672b-bf1b-4fbc-a152-351511d4b0a0 req-beff6771-e1e7-4275-b97d-276f2bfab7e8 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=07e04c0f-8286-42fc-96c2-0e366da529c6 HTTP/1.1" status: 200  len: 217 time: 0.0640318
May 25 16:39:09.539374 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f5b672b-bf1b-4fbc-a152-351511d4b0a0 req-e723b6c1-eef0-44db-a0bd-f1799d08883a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:09.541458 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7f5b672b-bf1b-4fbc-a152-351511d4b0a0 req-e723b6c1-eef0-44db-a0bd-f1799d08883a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=950695d6-8663-4ed4-92fd-b43d8ea5a820 HTTP/1.1" status: 200  len: 856 time: 0.0696120
May 25 16:39:09.541838 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba5cb53b-db5c-44d4-bd4d-998cc43c76ef req-9d55eea4-d4f7-4d23-b92b-21a61096e7dc tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:09.543428 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ba5cb53b-db5c-44d4-bd4d-998cc43c76ef req-9d55eea4-d4f7-4d23-b92b-21a61096e7dc tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1513603
May 25 16:39:09.610100 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ba5cb53b-db5c-44d4-bd4d-998cc43c76ef req-e4f36c0c-ce1a-4988-993d-680096d7faad tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0606189
May 25 16:39:09.660900 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f5b672b-bf1b-4fbc-a152-351511d4b0a0 req-dd9ef9ad-639c-4d45-bf5f-6312a2c7a521 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:09.662958 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7f5b672b-bf1b-4fbc-a152-351511d4b0a0 req-dd9ef9ad-639c-4d45-bf5f-6312a2c7a521 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b8cabc9a-0f6f-485c-8020-441b42ac019b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1124630
May 25 16:39:09.894206 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2574b365-0515-434f-9ea9-a65757b7451e req-d72ada92-8038-4f21-a58c-7d36c3d6af66 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:09.896012 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-d72ada92-8038-4f21-a58c-7d36c3d6af66 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.76 "GET /v2.0/networks?id=5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 HTTP/1.1" status: 200  len: 806 time: 0.2150321
May 25 16:39:09.936488 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7f5b672b-bf1b-4fbc-a152-351511d4b0a0 req-4fd7300f-ed52-410d-a151-bf949e09846f service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2556472
May 25 16:39:09.980340 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Request body: {'port': {'device_id': 'a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72', 'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0', 'admin_state_up': True, 'tenant_id': '73cf5a2c98e64235b56c6c8b43e872f5'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:10.106528 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-7f5b672b-bf1b-4fbc-a152-351511d4b0a0 req-20d91d39-b2c1-4e61-a4b6-3a8411d944ce service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1565671
May 25 16:39:10.190537 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8ef8f774-7e68-4545-8917-c98d74e3dc93 req-6b281c2e-26f8-4ee2-a87f-47a4b5b5b084 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 210 time: 0.2280993
May 25 16:39:10.223037 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ba406a-c88f-40b4-88f2-3804dc9eaf9f req-b8738310-fff1-47f7-b264-cbf7144a89b8 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:10.224548 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d6ba406a-c88f-40b4-88f2-3804dc9eaf9f req-b8738310-fff1-47f7-b264-cbf7144a89b8 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.3267381
May 25 16:39:10.226978 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:10.231340 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Usage tracker for resource:port and tenant:73cf5a2c98e64235b56c6c8b43e872f5 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:10.236233 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:10.263969 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:10.296864 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Made reservation on behalf of 73cf5a2c98e64235b56c6c8b43e872f5 for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:39:10.300761 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:10.320300 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d6ba406a-c88f-40b4-88f2-3804dc9eaf9f req-ca4b9c77-fea8-4e4e-8b58-46a61997b87b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0858905
May 25 16:39:10.488651 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Allocated IP 172.20.0.8 (5782c094-7ba9-4a97-a5bd-3f5f0a0557b0/4030a70d-20ce-4ddd-ab1c-d1d794468e8e/39b46d73-ca0c-4ca9-aacd-da8695a0eb59) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:39:10.710289 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:10.805705 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:10.815500 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:10.889275 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8433d26a-ed98-4b47-8eaa-3b0cbb4cae6c req-a9d3ff1a-ecf3-4594-849f-b9debe4ce9a8 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:10.890647 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8433d26a-ed98-4b47-8eaa-3b0cbb4cae6c req-a9d3ff1a-ecf3-4594-849f-b9debe4ce9a8 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1644125
May 25 16:39:10.892436 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Network 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:39:10.896947 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:10.902852 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:39:10.951534 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Pushing event updated for resources: {'Port': ['ID=39b46d73-ca0c-4ca9-aacd-da8695a0eb59,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:10.963803 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:10.997299 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8433d26a-ed98-4b47-8eaa-3b0cbb4cae6c req-71bd74a0-f28d-4149-a98b-ed7145eb129f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0954714
May 25 16:39:11.008307 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:11.008967 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:11.034497 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.0783877
May 25 16:39:11.388316 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3973ac29-d70c-46b8-8649-cba30572207f req-41e7598d-7d3f-4175-8004-cb70ea7e3771 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:11.389113 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-3973ac29-d70c-46b8-8649-cba30572207f req-41e7598d-7d3f-4175-8004-cb70ea7e3771 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Synchronizing usage tracker for tenant:73cf5a2c98e64235b56c6c8b43e872f5 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:39:11.416702 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-3973ac29-d70c-46b8-8649-cba30572207f req-41e7598d-7d3f-4175-8004-cb70ea7e3771 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Unset dirty status for tenant:73cf5a2c98e64235b56c6c8b43e872f5 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:39:11.421471 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3973ac29-d70c-46b8-8649-cba30572207f req-41e7598d-7d3f-4175-8004-cb70ea7e3771 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 931 time: 0.1238103
May 25 16:39:11.522761 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3973ac29-d70c-46b8-8649-cba30572207f req-a11dfdd4-25a6-451b-858b-712bc954bd03 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0956452
May 25 16:39:11.563041 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0eafae6-a561-483e-bb05-809ca074f633 req-57925f39-d429-4575-90e3-7bca9f371cf9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:11.570426 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c0eafae6-a561-483e-bb05-809ca074f633 req-57925f39-d429-4575-90e3-7bca9f371cf9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0949605
May 25 16:39:11.610425 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c0eafae6-a561-483e-bb05-809ca074f633 req-f89163ec-456e-41ae-9f95-15b2a2666d74 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391595
May 25 16:39:12.196314 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64e4f63b-dfea-48df-ba6d-5faa95788447 req-1fd3c1a2-f387-4e9a-991d-90bb6f2793e6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:12.197801 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-64e4f63b-dfea-48df-ba6d-5faa95788447 req-1fd3c1a2-f387-4e9a-991d-90bb6f2793e6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0835474
May 25 16:39:12.242574 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-64e4f63b-dfea-48df-ba6d-5faa95788447 req-40995bf2-f3c7-4156-9e78-9f33724b3886 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391440
May 25 16:39:12.718800 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a4a7ea-5533-4997-8b86-4f4b89202adc req-394199ff-bc07-4ec7-912b-ce03fa3aac0b tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:12.720487 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-66a4a7ea-5533-4997-8b86-4f4b89202adc req-394199ff-bc07-4ec7-912b-ce03fa3aac0b tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 931 time: 0.0846503
May 25 16:39:12.817503 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-66a4a7ea-5533-4997-8b86-4f4b89202adc req-6a42030c-ee23-47a8-b22e-313860768f0f tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0618484
May 25 16:39:12.842454 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cf9e37e-5cc3-40d8-8dfa-1464b7f7ee7f req-373af309-4e93-409c-a76c-017246ea41db tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:12.843900 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1cf9e37e-5cc3-40d8-8dfa-1464b7f7ee7f req-373af309-4e93-409c-a76c-017246ea41db tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.1200027
May 25 16:39:12.889753 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1cf9e37e-5cc3-40d8-8dfa-1464b7f7ee7f req-6d9aa27b-a69b-4288-9f8a-9e72b6bf5f0a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401087
May 25 16:39:12.956641 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Request body: {'port': {'device_id': 'a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:13.142589 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:13.511862 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39235845-294f-41f7-aea6-33b9b600e87c req-dc8474ad-300b-43ab-a439-80d9cbbc885f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:13.513851 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39235845-294f-41f7-aea6-33b9b600e87c req-dc8474ad-300b-43ab-a439-80d9cbbc885f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1529238
May 25 16:39:13.633044 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:39:13.645522 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39235845-294f-41f7-aea6-33b9b600e87c req-8d43128b-87a1-4940-a74e-f52ae944c114 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1203852
May 25 16:39:13.652477 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:13.677138 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Transition to ACTIVE for port object 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:13.683786 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:13.692568 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:13.872431 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Pushing event updated for resources: {'Port': ['ID=39b46d73-ca0c-4ca9-aacd-da8695a0eb59,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:13.876093 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:14.051502 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:14.087814 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Attempting to bind port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:39:14.088141 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Attempting to bind port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '73d0d26b-c8b0-4163-b874-267f21730cc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 440, 'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:39:14.088538 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Attempting to bind port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 on network 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:14.101600 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 on network 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:39:14.101919 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Attempting to bind port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 on network 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:14.111185 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 39, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:39:14.111520 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Checking segment: {'id': '73d0d26b-c8b0-4163-b874-267f21730cc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 440, 'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:39:14.111899 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Bound using segment: {'id': '73d0d26b-c8b0-4163-b874-267f21730cc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 440, 'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:39:14.112331 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Bound port: 39b46d73-ca0c-4ca9-aacd-da8695a0eb59, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '73d0d26b-c8b0-4163-b874-267f21730cc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 440, 'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:39:14.112668 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:14.172959 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e109cd-177d-4799-be99-e4e8f2d65ca9 req-afe72500-b749-4d52-b26e-7476a2cdcb9d tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:14.174826 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e1e109cd-177d-4799-be99-e4e8f2d65ca9 req-afe72500-b749-4d52-b26e-7476a2cdcb9d tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 943 time: 0.2368553
May 25 16:39:14.237363 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b25e1ee-b020-42f9-a6f4-a347aaae909b req-396d5f37-9194-416e-817e-89fe5e836a27 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:14.238841 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8b25e1ee-b020-42f9-a6f4-a347aaae909b req-396d5f37-9194-416e-817e-89fe5e836a27 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.2358339
May 25 16:39:14.289517 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] For port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:39:14.310337 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e1e109cd-177d-4799-be99-e4e8f2d65ca9 req-7916b816-ee93-4012-9dd1-ee8065bd6d5d tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1209135
May 25 16:39:14.313445 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] For port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=39b46d73-ca0c-4ca9-aacd-da8695a0eb59,segment=NetworkSegment(73d0d26b-c8b0-4163-b874-267f21730cc2),segment_id=73d0d26b-c8b0-4163-b874-267f21730cc2)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:39:14.320763 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:14.326113 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:14.363000 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8b25e1ee-b020-42f9-a6f4-a347aaae909b req-1a5da57d-511f-483e-98ea-b10fc152f1e7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1113832
May 25 16:39:14.399180 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:14.399787 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:14.401129 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] 10.222.0.76 "PUT /v2.0/ports/39b46d73-ca0c-4ca9-aacd-da8695a0eb59 HTTP/1.1" status: 200  len: 1093 time: 1.4497552
May 25 16:39:14.401620 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72', 'tag': '39b46d73-ca0c-4ca9-aacd-da8695a0eb59'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:39:14.409474 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Pushing event updated for resources: {'Port': ['ID=39b46d73-ca0c-4ca9-aacd-da8695a0eb59,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:14.413762 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:14.454690 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72', 'tag': '39b46d73-ca0c-4ca9-aacd-da8695a0eb59', 'status': 'completed', 'code': 200}
May 25 16:39:14.528923 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2574b365-0515-434f-9ea9-a65757b7451e req-518cdc79-51a5-481a-a696-989bdede45c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:14.530425 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-518cdc79-51a5-481a-a696-989bdede45c2 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=73cf5a2c98e64235b56c6c8b43e872f5&device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 1096 time: 0.0790250
May 25 16:39:14.604572 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-dbce2bc3-cc9b-4795-9f52-ec9fe9d81cb0 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=39b46d73-ca0c-4ca9-aacd-da8695a0eb59 HTTP/1.1" status: 200  len: 217 time: 0.0611479
May 25 16:39:14.684481 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2574b365-0515-434f-9ea9-a65757b7451e req-f031ff4c-032b-4ffa-a350-213b2cbb48a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:14.684481 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-f031ff4c-032b-4ffa-a350-213b2cbb48a8 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=4030a70d-20ce-4ddd-ab1c-d1d794468e8e HTTP/1.1" status: 200  len: 846 time: 0.0652025
May 25 16:39:14.736576 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-2929fedd-e19a-4515-97c7-bf9496d92243 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=5782c094-7ba9-4a97-a5bd-3f5f0a0557b0&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0431805
May 25 16:39:14.937842 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-eaffae98-49fb-4f4c-9e65-a5f08ff5f69d service neutron] 10.222.0.76 "GET /v2.0/networks/5782c094-7ba9-4a97-a5bd-3f5f0a0557b0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1944938
May 25 16:39:14.953997 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e13632dc-a1aa-4ab5-bb7b-f5e81d2d0813 req-69e36327-40ec-4df4-96ca-b7bc7f0e6604 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:14.955625 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e13632dc-a1aa-4ab5-bb7b-f5e81d2d0813 req-69e36327-40ec-4df4-96ca-b7bc7f0e6604 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1389925
May 25 16:39:15.157004 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54300) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:15.160649 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e13632dc-a1aa-4ab5-bb7b-f5e81d2d0813 req-20a88beb-ec3b-4022-9944-056f705d9bcc tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1126947
May 25 16:39:15.205541 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2574b365-0515-434f-9ea9-a65757b7451e req-6d5bf80d-5a9c-4fa9-808b-51d78d3e06bc service neutron] 10.222.0.76 "GET /v2.0/networks/5782c094-7ba9-4a97-a5bd-3f5f0a0557b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2489104
May 25 16:39:15.289871 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c4f1573d-16cd-420a-ae34-a431fbde04a8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:15.306809 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c4f1573d-16cd-420a-ae34-a431fbde04a8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:15.311546 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c4f1573d-16cd-420a-ae34-a431fbde04a8 admin admin] Usage tracker for resource:security_group_rule and tenant:32533bf8fe9b4d0f9c399758497094ef is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:15.315313 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c4f1573d-16cd-420a-ae34-a431fbde04a8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:15.322247 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c4f1573d-16cd-420a-ae34-a431fbde04a8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:15.345200 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-382495ae-88ba-41c7-b73c-0564103cd514 req-94b14396-f313-4b73-bd9c-e78308549be6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:15.347326 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-382495ae-88ba-41c7-b73c-0564103cd514 req-94b14396-f313-4b73-bd9c-e78308549be6 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=73cf5a2c98e64235b56c6c8b43e872f5&device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 1096 time: 0.0900424
May 25 16:39:15.456314 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c4f1573d-16cd-420a-ae34-a431fbde04a8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:15.462937 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c4f1573d-16cd-420a-ae34-a431fbde04a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:15.490850 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-fa9a4e78-5d23-43a1-b4da-2ea287d126b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:15.544554 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c4f1573d-16cd-420a-ae34-a431fbde04a8 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=32533bf8fe9b4d0f9c399758497094ef&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3863556
May 25 16:39:15.546840 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f1573d-16cd-420a-ae34-a431fbde04a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d5c0334-9b48-480c-ad87-0f9a47c4ef6a,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:15.560432 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54318) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:15.566323 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c4f1573d-16cd-420a-ae34-a431fbde04a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:15.657185 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bd3f8601-4850-4649-9a74-ec17418f91c9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:15.677254 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-382495ae-88ba-41c7-b73c-0564103cd514 req-3e3aa813-f5ea-47d2-9922-f9136d7387a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:15.680174 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-382495ae-88ba-41c7-b73c-0564103cd514 req-3e3aa813-f5ea-47d2-9922-f9136d7387a5 service neutron] 10.222.0.76 "GET /v2.0/networks?id=5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 HTTP/1.1" status: 200  len: 907 time: 0.3258402
May 25 16:39:15.689065 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bd3f8601-4850-4649-9a74-ec17418f91c9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:15.756197 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bd3f8601-4850-4649-9a74-ec17418f91c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:15.765738 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ed25b676-4823-444e-bd5d-082d6b599227 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:15.782854 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-382495ae-88ba-41c7-b73c-0564103cd514 req-2a7e35f1-66ef-498f-bbdb-53ce8dd8e586 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=39b46d73-ca0c-4ca9-aacd-da8695a0eb59 HTTP/1.1" status: 200  len: 217 time: 0.0929959
May 25 16:39:15.788573 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd3f8601-4850-4649-9a74-ec17418f91c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d5c0334-9b48-480c-ad87-0f9a47c4ef6a,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:15.793515 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-bd3f8601-4850-4649-9a74-ec17418f91c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:15.796059 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bd3f8601-4850-4649-9a74-ec17418f91c9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:15.805827 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-bd3f8601-4850-4649-9a74-ec17418f91c9 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/4d5c0334-9b48-480c-ad87-0f9a47c4ef6a HTTP/1.1" status: 204  len: 168 time: 0.2397318
May 25 16:39:15.885767 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-594589e3-bdac-478c-9a2d-b00a5d10f9e3 req-4a4bc652-7656-45d4-bc0c-e11d74e0553f tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:15.899522 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-594589e3-bdac-478c-9a2d-b00a5d10f9e3 req-4a4bc652-7656-45d4-bc0c-e11d74e0553f tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 943 time: 0.3611591
May 25 16:39:15.945734 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-382495ae-88ba-41c7-b73c-0564103cd514 req-cf065bb8-b965-4754-8fe5-74f4f4b4efb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:15.947648 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-382495ae-88ba-41c7-b73c-0564103cd514 req-cf065bb8-b965-4754-8fe5-74f4f4b4efb0 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=4030a70d-20ce-4ddd-ab1c-d1d794468e8e HTTP/1.1" status: 200  len: 846 time: 0.1545346
May 25 16:39:16.026222 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 07e04c0f-8286-42fc-96c2-0e366da529c6 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:39:16.104518 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-382495ae-88ba-41c7-b73c-0564103cd514 req-cd2c84f6-e048-49df-8854-d159e94e651e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=5782c094-7ba9-4a97-a5bd-3f5f0a0557b0&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1406999
May 25 16:39:16.123478 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-594589e3-bdac-478c-9a2d-b00a5d10f9e3 req-b0f567ce-20dc-47ad-8238-7a2a34c8e26c tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2227252
May 25 16:39:16.206740 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 07e04c0f-8286-42fc-96c2-0e366da529c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=07e04c0f-8286-42fc-96c2-0e366da529c6,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:16.224072 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'port_id': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'mac_address': 'fa:16:3e:09:7e:45', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 414, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:39:16.284608 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-382495ae-88ba-41c7-b73c-0564103cd514 req-7e4e3f21-6e3c-4989-b661-35db5b193ba8 service neutron] 10.222.0.76 "GET /v2.0/networks/5782c094-7ba9-4a97-a5bd-3f5f0a0557b0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1595113
May 25 16:39:16.356784 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:16.379398 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 07e04c0f-8286-42fc-96c2-0e366da529c6 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:39:16.391702 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54342) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:16.403893 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 07e04c0f-8286-42fc-96c2-0e366da529c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=07e04c0f-8286-42fc-96c2-0e366da529c6,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:16.409534 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:16.414116 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c42c7215-2a2c-4b61-8661-27e8ff6bf5d2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:16.416277 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bff7c790-b3de-4186-b950-8c37bc208dca admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:16.434572 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-bff7c790-b3de-4186-b950-8c37bc208dca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:16.440439 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-bff7c790-b3de-4186-b950-8c37bc208dca admin admin] Usage tracker for resource:security_group_rule and tenant:7ba5a443f9bc4369a99c9d21d22a5c79 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:16.446114 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-bff7c790-b3de-4186-b950-8c37bc208dca admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:16.466299 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-bff7c790-b3de-4186-b950-8c37bc208dca admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:16.530399 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=07e04c0f-8286-42fc-96c2-0e366da529c6,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:16.536960 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:16.598410 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bff7c790-b3de-4186-b950-8c37bc208dca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:16.602551 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bff7c790-b3de-4186-b950-8c37bc208dca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:16.611981 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a54330b6-7d7a-4e13-a741-844feb378522 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:16.670614 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bff7c790-b3de-4186-b950-8c37bc208dca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63eb9876-e3a5-4f00-9053-f40addf918ee,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:16.680645 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-bff7c790-b3de-4186-b950-8c37bc208dca admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=7ba5a443f9bc4369a99c9d21d22a5c79&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2876482
May 25 16:39:16.681920 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-bff7c790-b3de-4186-b950-8c37bc208dca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:16.682286 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54352) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:16.685372 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-382495ae-88ba-41c7-b73c-0564103cd514 req-095a73ce-7ef3-4d3a-bf1d-b0f87e78ea52 service neutron] 10.222.0.76 "GET /v2.0/networks/5782c094-7ba9-4a97-a5bd-3f5f0a0557b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3781047
May 25 16:39:16.702040 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32d18130-66a2-4f3b-af10-affc29387293 req-1c343cc4-6544-4e53-956c-640e867942bf tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:16.714854 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-32d18130-66a2-4f3b-af10-affc29387293 req-1c343cc4-6544-4e53-956c-640e867942bf tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.6792390
May 25 16:39:16.764355 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-afba03b5-9cff-4d89-b5ea-ed167ca0c1b3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:16.772372 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1aacd82-2ece-4ba4-9c37-f20e39597bf2 req-e61c8dd8-4748-4014-b4ae-fde83ac5b020 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:16.773857 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f1aacd82-2ece-4ba4-9c37-f20e39597bf2 req-e61c8dd8-4748-4014-b4ae-fde83ac5b020 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.4161234
May 25 16:39:16.788632 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-32d18130-66a2-4f3b-af10-affc29387293 req-08ca0eff-82be-4b22-9104-10c00d2337f9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0724921
May 25 16:39:16.797464 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-afba03b5-9cff-4d89-b5ea-ed167ca0c1b3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:16.838833 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f1aacd82-2ece-4ba4-9c37-f20e39597bf2 req-e3e6d3ce-ae7f-4ec8-b3df-da8a4ac2bd03 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0528312
May 25 16:39:16.866978 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-afba03b5-9cff-4d89-b5ea-ed167ca0c1b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:16.871868 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-60321d0e-4b02-4601-b47c-ef6485885bca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:16.885379 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afba03b5-9cff-4d89-b5ea-ed167ca0c1b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63eb9876-e3a5-4f00-9053-f40addf918ee,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:16.887699 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-afba03b5-9cff-4d89-b5ea-ed167ca0c1b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:16.896476 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-afba03b5-9cff-4d89-b5ea-ed167ca0c1b3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:16.897830 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-afba03b5-9cff-4d89-b5ea-ed167ca0c1b3 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/63eb9876-e3a5-4f00-9053-f40addf918ee HTTP/1.1" status: 204  len: 168 time: 0.2145309
May 25 16:39:17.399574 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fc57503-57ba-4cda-bd41-b631573ed5df req-b7a2a8ea-62a0-4f83-8301-63e66295bdb9 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:17.400878 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5fc57503-57ba-4cda-bd41-b631573ed5df req-b7a2a8ea-62a0-4f83-8301-63e66295bdb9 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 943 time: 0.0930784
May 25 16:39:17.456167 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5fc57503-57ba-4cda-bd41-b631573ed5df req-7d8393b6-fb69-4a6d-a68e-259e6d65715c tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0467989
May 25 16:39:17.986977 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6008909-0d4f-4b22-98fe-3e01467d77dd req-f0526359-0f7d-46c3-a6af-10fe6a4891e7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:17.988404 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a6008909-0d4f-4b22-98fe-3e01467d77dd req-f0526359-0f7d-46c3-a6af-10fe6a4891e7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 944 time: 0.0803530
May 25 16:39:18.035060 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a6008909-0d4f-4b22-98fe-3e01467d77dd req-cac9b104-b77b-42db-9de8-a447f38354b0 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404348
May 25 16:39:18.233179 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e279c5-20e0-4183-a077-661249e30f82 req-95a855dd-c6fd-43d1-9419-795dc12d3765 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:18.234647 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a7e279c5-20e0-4183-a077-661249e30f82 req-95a855dd-c6fd-43d1-9419-795dc12d3765 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0857830
May 25 16:39:18.279739 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a7e279c5-20e0-4183-a077-661249e30f82 req-1ffcffcf-8767-4ddd-aa4e-eafed28baf4b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382159
May 25 16:39:18.647713 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d974bae9-322d-4c98-9f3c-22de7bfc8183 req-05cdc5be-de10-4e6e-9abb-c84163261a57 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:18.649178 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d974bae9-322d-4c98-9f3c-22de7bfc8183 req-05cdc5be-de10-4e6e-9abb-c84163261a57 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 943 time: 0.0803218
May 25 16:39:18.695464 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d974bae9-322d-4c98-9f3c-22de7bfc8183 req-8e341761-ed28-426b-a400-f57a26c5bbe4 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404224
May 25 16:39:19.300772 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f59d40ea-36b9-4e02-a16f-495f35edc582 req-ee4bdc94-17c6-48c1-b0bf-ccb6a13e3232 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:19.302286 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f59d40ea-36b9-4e02-a16f-495f35edc582 req-ee4bdc94-17c6-48c1-b0bf-ccb6a13e3232 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 944 time: 0.1568348
May 25 16:39:19.348129 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f59d40ea-36b9-4e02-a16f-495f35edc582 req-625ab45a-33f2-45ed-ac9a-b3c365ea0ca7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390334
May 25 16:39:19.472385 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dc241ff-c0c8-461e-8809-f9cc21cabb70 req-5b3cc054-824f-4b19-aa2e-6507e749bef7 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:19.473931 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2dc241ff-c0c8-461e-8809-f9cc21cabb70 req-5b3cc054-824f-4b19-aa2e-6507e749bef7 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0890625
May 25 16:39:19.517827 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2dc241ff-c0c8-461e-8809-f9cc21cabb70 req-5b472fa9-4d62-47ac-a5a0-1f29136b9393 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0376861
May 25 16:39:19.882734 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4308da2-bf40-4026-8df8-b1932738d222 req-284da451-4966-4c27-ba8c-9cc8f8693525 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:19.884183 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d4308da2-bf40-4026-8df8-b1932738d222 req-284da451-4966-4c27-ba8c-9cc8f8693525 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 943 time: 0.0803959
May 25 16:39:19.929360 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d4308da2-bf40-4026-8df8-b1932738d222 req-a0a9d904-d9a1-4285-bf1e-1987d89c9176 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396345
May 25 16:39:20.537751 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23436778-e16e-41c7-968b-ca74b3d03584 req-712f2435-f48c-4880-be2a-4c24bcd43fd6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:20.539212 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-23436778-e16e-41c7-968b-ca74b3d03584 req-712f2435-f48c-4880-be2a-4c24bcd43fd6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 944 time: 0.0820131
May 25 16:39:20.586325 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-23436778-e16e-41c7-968b-ca74b3d03584 req-7f19113a-bd5c-4cb6-a883-ea01e7a7e5b7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414591
May 25 16:39:20.707905 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a77f643b-4503-4bf0-9ef4-a57f7b4194fe req-ee69f50d-3887-4891-b883-34dc1994a9d6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:20.709723 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a77f643b-4503-4bf0-9ef4-a57f7b4194fe req-ee69f50d-3887-4891-b883-34dc1994a9d6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0831182
May 25 16:39:20.762786 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a77f643b-4503-4bf0-9ef4-a57f7b4194fe req-feeccf90-a79d-4e17-bc5a-d0684021dc62 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455096
May 25 16:39:20.910197 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['07e04c0f-8286-42fc-96c2-0e366da529c6'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:39:21.130873 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf452df-c2ee-420a-b3c3-c8a76782817a req-c3948904-8782-4320-8fc4-9b9d00413470 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:21.132471 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cdf452df-c2ee-420a-b3c3-c8a76782817a req-c3948904-8782-4320-8fc4-9b9d00413470 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 943 time: 0.0869308
May 25 16:39:21.187486 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cdf452df-c2ee-420a-b3c3-c8a76782817a req-64c0474e-f5ae-42ab-bff3-2673b9e972ba tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0491240
May 25 16:39:21.773589 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0988a023-5fa1-4add-b9b2-3cfb6e771f14 req-8187815c-a4cf-4922-b56a-cf90da5a232f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:21.774940 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0988a023-5fa1-4add-b9b2-3cfb6e771f14 req-8187815c-a4cf-4922-b56a-cf90da5a232f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 944 time: 0.0796895
May 25 16:39:21.825757 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0988a023-5fa1-4add-b9b2-3cfb6e771f14 req-eab9a66c-3112-4f25-8fbe-f91acb058008 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0451303
May 25 16:39:21.954523 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d7cfe97-d7a6-421a-899f-621189ec23ec req-76fd1874-0eca-47bc-a45b-6ebaf043d644 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:21.955956 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6d7cfe97-d7a6-421a-899f-621189ec23ec req-76fd1874-0eca-47bc-a45b-6ebaf043d644 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0792592
May 25 16:39:22.000433 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6d7cfe97-d7a6-421a-899f-621189ec23ec req-4bd96243-98ac-48a4-a347-95e6c0c854fa tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388672
May 25 16:39:22.085018 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:39:22.089932 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 07e04c0f-8286-42fc-96c2-0e366da529c6 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:22.327182 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 07e04c0f-8286-42fc-96c2-0e366da529c6 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:22.340497 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 07e04c0f-8286-42fc-96c2-0e366da529c6 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:22.341169 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:22.415824 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=39b46d73-ca0c-4ca9-aacd-da8695a0eb59,segment=NetworkSegment(73d0d26b-c8b0-4163-b874-267f21730cc2),segment_id=73d0d26b-c8b0-4163-b874-267f21730cc2)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:22.433540 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '39b46d73-ca0c-4ca9-aacd-da8695a0eb59', 'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0', 'port_id': '39b46d73-ca0c-4ca9-aacd-da8695a0eb59', 'mac_address': 'fa:16:3e:28:e8:b9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 440, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4030a70d-20ce-4ddd-ab1c-d1d794468e8e', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:39:22.515932 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abe77acb-d625-4319-a3b3-f58ab39ff686 req-0ec70a9e-5bbc-4adc-9367-226d4d422706 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:22.517567 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-abe77acb-d625-4319-a3b3-f58ab39ff686 req-0ec70a9e-5bbc-4adc-9367-226d4d422706 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 943 time: 0.1538084
May 25 16:39:22.524815 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:22.531363 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b0466d-f533-43f2-94f0-78fd0fb15206 req-65aef2c4-d57c-4576-8840-b7b771f95d55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:22.533073 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d4b0466d-f533-43f2-94f0-78fd0fb15206 req-65aef2c4-d57c-4576-8840-b7b771f95d55 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 1099 time: 0.1262341
May 25 16:39:22.553388 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:39:22.620669 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d4b0466d-f533-43f2-94f0-78fd0fb15206 req-894223b0-1a66-4448-ab17-e2e89a6bb870 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0731936
May 25 16:39:22.635924 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-abe77acb-d625-4319-a3b3-f58ab39ff686 req-d73ea184-dd46-497d-954f-587ad6a2629f tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1072083
May 25 16:39:22.646264 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=39b46d73-ca0c-4ca9-aacd-da8695a0eb59,segment=NetworkSegment(73d0d26b-c8b0-4163-b874-267f21730cc2),segment_id=73d0d26b-c8b0-4163-b874-267f21730cc2)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:22.658054 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:22.662164 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:22.700770 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:22.752278 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:39:22.763087 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=39b46d73-ca0c-4ca9-aacd-da8695a0eb59,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:22.767481 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:22.769972 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 07e04c0f-8286-42fc-96c2-0e366da529c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=07e04c0f-8286-42fc-96c2-0e366da529c6,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:22.776081 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:22.778245 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:22.813255 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'code': 200}
May 25 16:39:22.862849 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=07e04c0f-8286-42fc-96c2-0e366da529c6,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:22.876292 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:23.010036 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['39b46d73-ca0c-4ca9-aacd-da8695a0eb59'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:39:23.108975 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16b8d164-1980-4245-b9ec-308adde93d11 req-822beaf3-5153-44b3-8af9-bcde8f8e7545 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:23.113929 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-16b8d164-1980-4245-b9ec-308adde93d11 req-822beaf3-5153-44b3-8af9-bcde8f8e7545 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1538222
May 25 16:39:23.186758 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66311aa9-dd76-4a8a-a618-76f70071f909 req-c6424d99-a3d1-4242-ab71-e6485df4aaaa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:23.186758 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-66311aa9-dd76-4a8a-a618-76f70071f909 req-c6424d99-a3d1-4242-ab71-e6485df4aaaa service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 1098 time: 0.1779282
May 25 16:39:23.233099 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-16b8d164-1980-4245-b9ec-308adde93d11 req-423225f2-da98-4a61-bce6-417caec03480 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1150196
May 25 16:39:23.260268 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-66311aa9-dd76-4a8a-a618-76f70071f909 req-901c3504-41ae-46e8-af0c-f052d024f1cb service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0581355
May 25 16:39:23.273865 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abf0b1bc-5966-4c30-8b63-c3ebc31b879e req-e4fcdd56-da3e-454f-b471-b9d8fd2b18d9 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:23.275255 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-abf0b1bc-5966-4c30-8b63-c3ebc31b879e req-e4fcdd56-da3e-454f-b471-b9d8fd2b18d9 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1425586
May 25 16:39:23.323517 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-abf0b1bc-5966-4c30-8b63-c3ebc31b879e req-287ef879-f508-480a-af64-a96b5add0741 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0423729
May 25 16:39:23.846300 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fda3b09-3910-462d-a571-d871263785f1 req-da4cc5c7-4895-4319-b531-bbe11e47b995 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:23.847748 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8fda3b09-3910-462d-a571-d871263785f1 req-da4cc5c7-4895-4319-b531-bbe11e47b995 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 944 time: 0.0879700
May 25 16:39:23.894193 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8fda3b09-3910-462d-a571-d871263785f1 req-8a5f485c-0675-4d30-ab0e-a81d8ca3d837 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406618
May 25 16:39:24.435894 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af5fd91-ce35-4c22-b981-7cd0779d6757 req-24107950-2b08-482c-85b4-b3177540f25f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:24.437987 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0af5fd91-ce35-4c22-b981-7cd0779d6757 req-24107950-2b08-482c-85b4-b3177540f25f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.0931561
May 25 16:39:24.540493 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0af5fd91-ce35-4c22-b981-7cd0779d6757 req-aff79d98-ff67-442e-a44f-f870434e18de tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0627453
May 25 16:39:24.567841 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55fdd9a4-d169-4472-8f7e-44103227c122 req-1cd913c7-ab87-41a7-bd72-4a4de01d87da tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:24.567841 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55fdd9a4-d169-4472-8f7e-44103227c122 req-1cd913c7-ab87-41a7-bd72-4a4de01d87da tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1241250
May 25 16:39:24.609058 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55fdd9a4-d169-4472-8f7e-44103227c122 req-a87132f1-7846-4366-a8cd-1fd47e67b448 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394948
May 25 16:39:25.186133 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc61cd93-aff8-41c8-bb09-929a9d81875d req-75f96305-708d-4941-b5a5-0191a8547e41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:25.187731 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cc61cd93-aff8-41c8-bb09-929a9d81875d req-75f96305-708d-4941-b5a5-0191a8547e41 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fe57668427364ea7acb08a0f7f2826ed&device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 1099 time: 0.2730041
May 25 16:39:25.206172 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae3b431c-22fc-4f2b-baae-efe3305fb1a0 req-5409bcea-b9f4-4b14-8f37-4152e49bfa38 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:25.207566 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ae3b431c-22fc-4f2b-baae-efe3305fb1a0 req-5409bcea-b9f4-4b14-8f37-4152e49bfa38 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.2420492
May 25 16:39:25.304087 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d906f611-5738-4d7c-afb8-75c3d5670331 req-3cb82056-80da-499c-ba94-9d4bbfdb4d73 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:25.306083 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d906f611-5738-4d7c-afb8-75c3d5670331 req-3cb82056-80da-499c-ba94-9d4bbfdb4d73 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 944 time: 0.2930436
May 25 16:39:25.379920 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ae3b431c-22fc-4f2b-baae-efe3305fb1a0 req-1991469d-e9ba-42f4-832b-3552641447f7 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1538684
May 25 16:39:25.420977 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d906f611-5738-4d7c-afb8-75c3d5670331 req-9622a999-3dc9-4d71-b122-cc87fb9c903b tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1049592
May 25 16:39:25.425978 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc61cd93-aff8-41c8-bb09-929a9d81875d req-6200ba20-7f14-46f7-aa0f-aecc2a0b282d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:25.427390 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cc61cd93-aff8-41c8-bb09-929a9d81875d req-6200ba20-7f14-46f7-aa0f-aecc2a0b282d service neutron] 10.222.0.76 "GET /v2.0/networks?id=1186d694-166f-4246-b68b-e7ce60cb0f02 HTTP/1.1" status: 200  len: 918 time: 0.2292500
May 25 16:39:25.509897 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cc61cd93-aff8-41c8-bb09-929a9d81875d req-514ee3c9-8bda-42f3-82e4-90ec4ee78872 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d HTTP/1.1" status: 200  len: 217 time: 0.0751379
May 25 16:39:25.579235 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc61cd93-aff8-41c8-bb09-929a9d81875d req-9edb64ff-a6fe-4997-a006-10fd709e8887 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:25.580761 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cc61cd93-aff8-41c8-bb09-929a9d81875d req-9edb64ff-a6fe-4997-a006-10fd709e8887 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5e6146eb-31ff-437b-a594-8ddb1d63042e HTTP/1.1" status: 200  len: 857 time: 0.0618122
May 25 16:39:25.633963 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cc61cd93-aff8-41c8-bb09-929a9d81875d req-a4f15727-f188-4bad-8ba9-1b723df32b64 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=1186d694-166f-4246-b68b-e7ce60cb0f02&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0466886
May 25 16:39:25.821210 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cc61cd93-aff8-41c8-bb09-929a9d81875d req-bea78ddc-6f88-4d0f-904f-0c176076ce7e service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1801219
May 25 16:39:25.834510 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d6da116-b466-4d27-b628-82ab120b3bf7 req-2a461370-6816-4df1-baba-326811e12255 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:25.836402 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d6da116-b466-4d27-b628-82ab120b3bf7 req-2a461370-6816-4df1-baba-326811e12255 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1743364
May 25 16:39:25.961569 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d6da116-b466-4d27-b628-82ab120b3bf7 req-544dac6e-5f2f-4a92-a422-1e33aa5ba5ce tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1064143
May 25 16:39:25.998957 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cc61cd93-aff8-41c8-bb09-929a9d81875d req-783d1882-e9eb-41b7-b04a-7dff1e6421bc service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1608672
May 25 16:39:26.102987 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:26.161934 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b11f5bd0-5811-4e51-b4a2-375109973013 req-c97cdc32-ee6d-4cd0-a224-22f80d9ce409 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:26.164379 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b11f5bd0-5811-4e51-b4a2-375109973013 req-c97cdc32-ee6d-4cd0-a224-22f80d9ce409 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.0890396
May 25 16:39:26.172627 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 54560) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:26.177816 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-c2c65f1e-fac4-4063-8373-e2a665ad90a7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Request body: {'floatingip': {'port_id': '07e04c0f-8286-42fc-96c2-0e366da529c6'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:26.185669 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:26.190719 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:26.191094 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:26.262585 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c2c65f1e-fac4-4063-8373-e2a665ad90a7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:26.309890 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54568) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:26.365485 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:26.396418 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39b46d73-ca0c-4ca9-aacd-da8695a0eb59'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:39:26.409619 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=39b46d73-ca0c-4ca9-aacd-da8695a0eb59,segment=NetworkSegment(73d0d26b-c8b0-4163-b874-267f21730cc2),segment_id=73d0d26b-c8b0-4163-b874-267f21730cc2)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:26.417378 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:26.421753 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:26.470931 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:26.509299 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:26.518422 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Usage tracker for resource:security_group_rule and tenant:c213f93b5c5c47619608135931dc910a is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:26.521853 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39b46d73-ca0c-4ca9-aacd-da8695a0eb59', 'code': 200}
May 25 16:39:26.524165 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:26.537463 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=39b46d73-ca0c-4ca9-aacd-da8695a0eb59,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:26.539357 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:26.545765 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:26.655119 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:26.661001 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:26.672453 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3bbfa19a-fd84-48bd-97ef-a9b6abae02eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:26.711491 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=846afe7a-e82a-4758-ab18-97ae7e541939,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:26.740570 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:26.741031 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:26.741422 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:26.741936 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:26.742290 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:26.742641 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:26.742987 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:26.743511 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:26.743708 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:26.744327 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:26.744831 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:26.745339 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:26.749781 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:26.752422 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=c213f93b5c5c47619608135931dc910a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4415698
May 25 16:39:26.755254 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54586) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:26.819607 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-795e514a-371a-4695-82e8-304cbb338ad4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:26.848921 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-795e514a-371a-4695-82e8-304cbb338ad4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:26.906120 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-795e514a-371a-4695-82e8-304cbb338ad4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:26.911129 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-bff7c790-b3de-4186-b950-8c37bc208dca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:26.924468 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-795e514a-371a-4695-82e8-304cbb338ad4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=846afe7a-e82a-4758-ab18-97ae7e541939,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:26.927555 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-795e514a-371a-4695-82e8-304cbb338ad4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:26.929852 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-795e514a-371a-4695-82e8-304cbb338ad4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:26.930969 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-795e514a-371a-4695-82e8-304cbb338ad4 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/846afe7a-e82a-4758-ab18-97ae7e541939 HTTP/1.1" status: 204  len: 168 time: 0.1741011
May 25 16:39:27.046255 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1da4ced-c39c-44fd-a271-ecb513b50559 req-34172b01-124b-41c6-8d6b-49681b76d097 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:27.047438 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a1da4ced-c39c-44fd-a271-ecb513b50559 req-34172b01-124b-41c6-8d6b-49681b76d097 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.4677546
May 25 16:39:27.331577 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508c34de-75db-4f77-8794-c73ccfe22be1 req-020b9d6c-cf5f-4194-9edc-dc80f31bfcff tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:27.332929 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-508c34de-75db-4f77-8794-c73ccfe22be1 req-020b9d6c-cf5f-4194-9edc-dc80f31bfcff tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 945 time: 0.6021163
May 25 16:39:27.349541 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f31bb08c-db67-4fcc-870f-7a5527182cab req-6307761e-ff3d-450f-a47a-0accb2ba4c9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:27.350942 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f31bb08c-db67-4fcc-870f-7a5527182cab req-6307761e-ff3d-450f-a47a-0accb2ba4c9f service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 1098 time: 0.6154089
May 25 16:39:27.372338 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a1da4ced-c39c-44fd-a271-ecb513b50559 req-fbc639e5-c211-4237-ac00-ddddd0df095b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2651634
May 25 16:39:27.449551 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-508c34de-75db-4f77-8794-c73ccfe22be1 req-60c1d112-8f20-4d24-8787-671cac4b8c4f tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1024160
May 25 16:39:27.465897 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f31bb08c-db67-4fcc-870f-7a5527182cab req-09dba9c4-33fb-476e-8884-8d43cfcb4963 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0895545
May 25 16:39:27.624231 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c2c65f1e-fac4-4063-8373-e2a665ad90a7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:27.628830 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c2c65f1e-fac4-4063-8373-e2a665ad90a7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:27.807730 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.l3_db [None req-c2c65f1e-fac4-4063-8373-e2a665ad90a7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Floating IP 080265cc-e8b2-46ad-ad82-80676ac12375 associated. External IP: 172.27.3.100, port: 07e04c0f-8286-42fc-96c2-0e366da529c6.
May 25 16:39:28.117677 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54604) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:28.169912 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c2c65f1e-fac4-4063-8373-e2a665ad90a7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:39:28.249709 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-be70c0c0-7b5a-4ad2-93d8-6f4abb959bfe admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:28.264842 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-be70c0c0-7b5a-4ad2-93d8-6f4abb959bfe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:28.269075 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-be70c0c0-7b5a-4ad2-93d8-6f4abb959bfe admin admin] Usage tracker for resource:security_group_rule and tenant:b3f23e53411b4b33a54bca2e4df51516 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:28.272142 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-be70c0c0-7b5a-4ad2-93d8-6f4abb959bfe admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:28.277904 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-be70c0c0-7b5a-4ad2-93d8-6f4abb959bfe admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:28.368112 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-be70c0c0-7b5a-4ad2-93d8-6f4abb959bfe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:28.372040 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-be70c0c0-7b5a-4ad2-93d8-6f4abb959bfe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:28.381957 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c0a67b01-920f-48de-b423-2dadb69b8343 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:28.428611 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-be70c0c0-7b5a-4ad2-93d8-6f4abb959bfe admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=b3f23e53411b4b33a54bca2e4df51516&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3092780
May 25 16:39:28.438517 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 54612) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:28.446949 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be70c0c0-7b5a-4ad2-93d8-6f4abb959bfe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b2d8ed4-da10-42df-8074-6833ca90b696,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:28.450818 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-be70c0c0-7b5a-4ad2-93d8-6f4abb959bfe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:28.506850 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c2c65f1e-fac4-4063-8373-e2a665ad90a7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:39:28.512834 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c2c65f1e-fac4-4063-8373-e2a665ad90a7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:28.518431 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d59106f-8b34-4711-80c8-b4f00b0ec950 None None] Sync routers for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:39:28.532199 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d59106f-8b34-4711-80c8-b4f00b0ec950 None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:39:28.534133 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-5d59106f-8b34-4711-80c8-b4f00b0ec950 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346c3eab80>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:39:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:28.627222 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:28.697329 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-c2c65f1e-fac4-4063-8373-e2a665ad90a7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "PUT /v2.0/floatingips/080265cc-e8b2-46ad-ad82-80676ac12375 HTTP/1.1" status: 200  len: 991 time: 2.5234685
May 25 16:39:28.702931 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:39:28.739940 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:28.787858 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-5d59106f-8b34-4711-80c8-b4f00b0ec950 None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:39:28.802606 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3445d48-ddfb-4d44-9bb3-46f95caaa362 req-6ba00dec-6fc0-4532-aa12-6b8c199b133c tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:28.804120 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e3445d48-ddfb-4d44-9bb3-46f95caaa362 req-6ba00dec-6fc0-4532-aa12-6b8c199b133c tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.2592711
May 25 16:39:28.822106 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b4e5043-c23d-455a-ad1c-546af923102e req-cf684125-ace1-45e1-b257-750da04ab073 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:28.823633 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1b4e5043-c23d-455a-ad1c-546af923102e req-cf684125-ace1-45e1-b257-750da04ab073 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 945 time: 0.2016556
May 25 16:39:28.899734 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e3445d48-ddfb-4d44-9bb3-46f95caaa362 req-1caef5b4-9323-4361-8153-744a295a2a39 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0861146
May 25 16:39:28.902885 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:28.909242 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-3fb8badf-68fb-42fa-aff5-4ce757f06069 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:28.930572 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1b4e5043-c23d-455a-ad1c-546af923102e req-f13aef0b-986d-4d88-ac45-5e54e61293d4 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0904753
May 25 16:39:28.940530 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b2d8ed4-da10-42df-8074-6833ca90b696,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:28.949811 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:28.950344 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:28.950786 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:28.951222 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:28.951853 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:28.952549 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:28.953109 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:28.953643 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:28.954092 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:28.954953 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:28.955395 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:28.955826 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:28.966035 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:28.970333 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/0b2d8ed4-da10-42df-8074-6833ca90b696 HTTP/1.1" status: 204  len: 168 time: 0.5284276
May 25 16:39:28.970333 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:29.153381 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-5d59106f-8b34-4711-80c8-b4f00b0ec950 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346c3eab80>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '080265cc-e8b2-46ad-ad82-80676ac12375', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'floating_ip_address': '172.27.3.100', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'port_id': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 314, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'mac_address': 'fa:16:3e:09:7e:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f193b888-613a-4d01-a738-0c43d97877b4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:38:55Z', 'updated_at': '2021-05-25T16:39:27Z', 'revision_number': 1, 'project_id': '9c4a08443867402386f8ec58d2615739', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:59Z', 'revision_number': 5, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:29.158922 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d59106f-8b34-4711-80c8-b4f00b0ec950 None None] Checking router: c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:39:29.171265 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d59106f-8b34-4711-80c8-b4f00b0ec950 None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:39:29.172055 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-5d59106f-8b34-4711-80c8-b4f00b0ec950 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346c3eab80>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:39:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:29.183917 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'status': 'completed', 'code': 200}
May 25 16:39:29.469118 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-5d59106f-8b34-4711-80c8-b4f00b0ec950 None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:39:29.541674 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51fb202a-d79f-489f-bd8c-bef67f47e61a req-48f0d872-cd0e-4727-9a47-276d3190fb6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:29.544213 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-51fb202a-d79f-489f-bd8c-bef67f47e61a req-48f0d872-cd0e-4727-9a47-276d3190fb6a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9c4a08443867402386f8ec58d2615739&device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 1098 time: 0.3191979
May 25 16:39:29.555782 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-909d376f-dfaa-4982-ad81-df4e3e111de9 req-d90c699b-2260-433c-979e-6208de1e21a2 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:29.557380 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-909d376f-dfaa-4982-ad81-df4e3e111de9 req-d90c699b-2260-433c-979e-6208de1e21a2 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.2293160
May 25 16:39:29.777528 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-909d376f-dfaa-4982-ad81-df4e3e111de9 req-884deb8e-9f1a-4228-b661-5ad9b14d8be7 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1973011
May 25 16:39:29.838966 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51fb202a-d79f-489f-bd8c-bef67f47e61a req-641e810f-d9b9-4574-97a5-ff855173a7e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:29.840407 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-51fb202a-d79f-489f-bd8c-bef67f47e61a req-641e810f-d9b9-4574-97a5-ff855173a7e1 service neutron] 10.222.0.76 "GET /v2.0/networks?id=b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 200  len: 918 time: 0.2821844
May 25 16:39:29.909544 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54662) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:29.926617 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b73215d-990a-4d22-9107-d0f6e50efced req-51ad4c59-6bf0-4f57-91ce-c22735647e77 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:29.928178 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-5d59106f-8b34-4711-80c8-b4f00b0ec950 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346c3eab80>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '080265cc-e8b2-46ad-ad82-80676ac12375', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'floating_ip_address': '172.27.3.100', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'port_id': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 314, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'mac_address': 'fa:16:3e:09:7e:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f193b888-613a-4d01-a738-0c43d97877b4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:38:55Z', 'updated_at': '2021-05-25T16:39:27Z', 'revision_number': 1, 'project_id': '9c4a08443867402386f8ec58d2615739', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:59Z', 'revision_number': 5, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:29.930170 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-51ad4c59-6bf0-4f57-91ce-c22735647e77 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/networks?id=e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 200  len: 814 time: 0.2805383
May 25 16:39:29.933975 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d59106f-8b34-4711-80c8-b4f00b0ec950 None None] The sync data for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi is: [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '080265cc-e8b2-46ad-ad82-80676ac12375', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'floating_ip_address': '172.27.3.100', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'port_id': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 314, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'mac_address': 'fa:16:3e:09:7e:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f193b888-613a-4d01-a738-0c43d97877b4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:38:55Z', 'updated_at': '2021-05-25T16:39:27Z', 'revision_number': 1, 'project_id': '9c4a08443867402386f8ec58d2615739', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:59Z', 'revision_number': 5, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:39:29.966097 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-6cdcc6f3-f51c-430a-9a87-6184cb513d9f tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/quotas/2441ab18acee4d4c9e276ba69a458348 HTTP/1.1" status: 200  len: 375 time: 0.0169864
May 25 16:39:30.024315 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-51fb202a-d79f-489f-bd8c-bef67f47e61a req-07174003-9aca-46ba-84eb-b58bc8b1e149 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=07e04c0f-8286-42fc-96c2-0e366da529c6 HTTP/1.1" status: 200  len: 999 time: 0.1684351
May 25 16:39:30.043460 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1661198402-network', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:30.049914 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:30.053808 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Usage tracker for resource:network and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:30.056919 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:30.062667 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:30.073342 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Made reservation on behalf of a723bbfba23f463dbb8da0bdacb4b0aa for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:39:30.075739 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:30.092503 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:30.108970 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:30.112947 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Usage tracker for resource:security_group_rule and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:30.115845 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:30.122393 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:30.168655 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51fb202a-d79f-489f-bd8c-bef67f47e61a req-bde9848f-c153-4dcc-82d1-25a87ca50d5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:30.169931 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-51fb202a-d79f-489f-bd8c-bef67f47e61a req-bde9848f-c153-4dcc-82d1-25a87ca50d5a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=950695d6-8663-4ed4-92fd-b43d8ea5a820 HTTP/1.1" status: 200  len: 856 time: 0.1352699
May 25 16:39:30.177780 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5851fcdd-6193-4664-9a54-72fc326fb236 None None] New status for floating IP 080265cc-e8b2-46ad-ad82-80676ac12375: ACTIVE {{(pid=92014) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:39:30.223302 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:30.227910 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:30.232088 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-baaab411-239c-41bb-9ec8-61164944c680 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:30.259686 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-1f7c8183-dc79-4115-93ce-88c78668b5f1 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=2441ab18acee4d4c9e276ba69a458348&fields=id HTTP/1.1" status: 200  len: 348 time: 0.2779608
May 25 16:39:30.261319 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 401}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:39:30.271948 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7509affe-c1e4-4a50-a09a-a747b31827d3,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:30.276329 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:30.279068 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:30.279413 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Added segment 19ecc07e-d399-4943-af92-0daf09e9ec93 of type vlan for network 3e40698a-e2cb-4812-9711-e3b481dbc8b3
May 25 16:39:30.293275 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc32cd8f-5f62-4574-9bfc-c7f51f2df8d6 req-4c5481da-20c4-420b-a220-46aa664675bb tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:30.294849 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cc32cd8f-5f62-4574-9bfc-c7f51f2df8d6 req-4c5481da-20c4-420b-a220-46aa664675bb tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.2285504
May 25 16:39:30.313917 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:30.360008 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:30.361437 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:30.362053 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:30.365478 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:30.430877 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cc32cd8f-5f62-4574-9bfc-c7f51f2df8d6 req-6448dc6e-9df3-4e87-b040-246b5302a9d0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0838220
May 25 16:39:30.450571 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51fb202a-d79f-489f-bd8c-bef67f47e61a req-2909beef-c77c-4085-8d1c-667e8d98fa95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:30.452434 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-51fb202a-d79f-489f-bd8c-bef67f47e61a req-2909beef-c77c-4085-8d1c-667e8d98fa95 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b8cabc9a-0f6f-485c-8020-441b42ac019b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2735236
May 25 16:39:30.479592 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Pushing event updated for resources: {'Network': ['ID=3e40698a-e2cb-4812-9711-e3b481dbc8b3,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:30.486602 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:30.487627 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-7b55f01b-46b6-4c16-831f-a6e4d4a5701c service neutron] 10.222.0.73 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2271190
May 25 16:39:30.488834 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.5782800
May 25 16:39:30.497228 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:39:30.497843 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54676) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:30.504672 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Request body: {'subnet': {'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1661198402-subnet', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'ip_version': 4}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:30.510534 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:30.514765 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Usage tracker for resource:subnet and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:30.519098 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:30.525590 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:30.539893 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Made reservation on behalf of a723bbfba23f463dbb8da0bdacb4b0aa for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:39:30.544881 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-697612'] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:30.870659 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-51fb202a-d79f-489f-bd8c-bef67f47e61a req-6deeb347-d041-4d0d-99ec-60209805a86c service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4107637
May 25 16:39:30.933600 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-1553ad94-d75c-471e-b3c8-9e93ee2c3250 service neutron] 10.222.0.73 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3959987
May 25 16:39:31.026048 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae435c0-536c-4cd7-a603-cdc121d25f78 req-c3e3b02a-f1e5-44cd-930d-0ece0f0f7e0c tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:31.027535 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7ae435c0-536c-4cd7-a603-cdc121d25f78 req-c3e3b02a-f1e5-44cd-930d-0ece0f0f7e0c tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 945 time: 0.2897046
May 25 16:39:31.122544 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-51fb202a-d79f-489f-bd8c-bef67f47e61a req-2c95069a-4a52-4733-a805-e612991399e4 service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2317791
May 25 16:39:31.138266 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7ae435c0-536c-4cd7-a603-cdc121d25f78 req-f5fed667-acb6-4d8a-be05-e5c2110f9b2f tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0969007
May 25 16:39:31.269050 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7721570', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-697626'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:31.274819 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:31.357055 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Pushing event updated for resources: {'Subnet': ['ID=6203ecab-ef7b-4872-ac7a-33ea4cfae323,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:31.363578 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:31.365695 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Checking segment: {'id': '19ecc07e-d399-4943-af92-0daf09e9ec93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 401, 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:39:31.366054 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Network hostable DHCP agents. Network: 3e40698a-e2cb-4812-9711-e3b481dbc8b3, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:39:31.388138 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:39:31.395456 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-31e162ba-dabc-4e49-a2d8-6fa3be29d431 req-acd48460-85e7-496d-b708-428d3bb72bea tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 210 time: 0.1089907
May 25 16:39:31.404011 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, 3e40698a-e2cb-4812-9711-e3b481dbc8b3) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:31.421254 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:31.422069 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:31.422408 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19fd2163-db7c-43a5-9083-af781c31b041 None None] Network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:39:31.450226 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1455fe4-97c1-4c79-82d7-38af6340ad8a req-a98aa059-3ebd-4ed4-941b-0920548a83e2 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:31.451664 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d1455fe4-97c1-4c79-82d7-38af6340ad8a req-a98aa059-3ebd-4ed4-941b-0920548a83e2 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1196854
May 25 16:39:31.454878 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c40fe009-d945-405b-b8d2-7a698147f25c admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.9554927
May 25 16:39:31.457739 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54698) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:31.464209 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:31.469641 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:31.474142 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Usage tracker for resource:router and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:31.477914 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:31.484826 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:31.498972 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-506971', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2375'] for router, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:31.500125 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-504667', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-501124', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1593705', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2380'] for router, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:31.508893 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d1455fe4-97c1-4c79-82d7-38af6340ad8a req-53d2f868-c88e-49ce-8c4c-ec1f65555cbe tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0484121
May 25 16:39:31.519047 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:31.528421 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-01fe8c85-d150-41c6-92e9-aeeaf866e4c6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:31.743356 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d60576c-5158-50e8-99d6-6272b1af5e3f-3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'fixed_ips': [{'subnet_id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323'}]}} from dv-cinder-786386-6-iscsi. {{(pid=92014) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 16:39:31.744419 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:31.837489 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-501153', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-506985', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2362'] for router, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:31.933348 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.db_base_plugin_common [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Allocated IP 172.20.0.2 (3e40698a-e2cb-4812-9711-e3b481dbc8b3/6203ecab-ef7b-4872-ac7a-33ea4cfae323/9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8) {{(pid=92014) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:39:32.157331 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Notify callbacks [] for port, precommit_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:32.167105 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:32.169555 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Transition to ACTIVE for port object 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:32.191784 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Transition to ACTIVE for port object 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 will not be triggered until provisioned by entity DHCP. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:32.202192 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:32.209914 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:32.220294 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:32.316499 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 is already hosted by enough agents. {{(pid=92014) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:39:32.321229 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.base_scheduler [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Resources bound (agent type, host, resource id):  {{(pid=92014) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:32.325619 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Received port after_create {{(pid=92014) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:39:32.333441 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Pushing event updated for resources: {'Port': ['ID=9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8,revision_number=1']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:32.380811 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:32.381633 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:32.386304 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:32.386836 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:32.387324 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:32.387842 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:32.388361 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:32.388840 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:32.389194 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:32.389544 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:32.389862 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:32.390225 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:39:32.400071 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:32.433281 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4b50b09-cd12-4798-a355-9938048487c8 req-d48ace4f-856a-413b-b940-04464440a9e0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:32.434843 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b4b50b09-cd12-4798-a355-9938048487c8 req-d48ace4f-856a-413b-b940-04464440a9e0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1322179
May 25 16:39:32.462358 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Allocated IP 172.27.3.104 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:39:32.474887 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Attempting to bind port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:39:32.475863 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Attempting to bind port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '19ecc07e-d399-4943-af92-0daf09e9ec93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 401, 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:39:32.476314 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Attempting to bind port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 on network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:32.483392 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 39, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:39:32.483871 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Checking segment: {'id': '19ecc07e-d399-4943-af92-0daf09e9ec93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 401, 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:39:32.484327 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:32.484898 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Bound using segment: {'id': '19ecc07e-d399-4943-af92-0daf09e9ec93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 401, 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:39:32.485364 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Bound port: 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '19ecc07e-d399-4943-af92-0daf09e9ec93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 401, 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:39:32.485797 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:32.591105 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] For port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:39:32.595451 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] For port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:39:32.602023 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:32.610416 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:32.620288 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b4b50b09-cd12-4798-a355-9938048487c8 req-d8a60721-faa2-42c3-a061-809a618bded6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1792498
May 25 16:39:32.674921 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:32.728474 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Pushing event updated for resources: {'Port': ['ID=9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:32.734678 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b73215d-990a-4d22-9107-d0f6e50efced req-e9532322-83e3-42b7-9d68-c77e9f4cb5fd tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:32.736536 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-e9532322-83e3-42b7-9d68-c77e9f4cb5fd tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "GET /v2.0/networks?id=e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 200  len: 814 time: 0.2763455
May 25 16:39:32.736832 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:32.737913 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:32.755625 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c13253c1-102c-4d28-886b-4d5ee1498225 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:32.791760 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Request body: {'port': {'device_id': '207381c7-af2d-4515-9ed9-8e1fb121ef03', 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42', 'admin_state_up': True, 'tenant_id': '2441ab18acee4d4c9e276ba69a458348'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:32.833517 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:39:32.836879 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:32.839684 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:39:32.891073 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Pushing event updated for resources: {'Port': ['ID=ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:32.899867 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:32.967217 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3ca3b9f5-03e5-4009-80ca-979834754a09 req-2a4b8ef2-8cf4-455b-862f-934cb0ca8903 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 210 time: 0.0943656
May 25 16:39:33.050959 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:33.062356 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:33.079782 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a565d92c-f782-4204-a41a-d4f1253f4411 req-30863778-454b-4fce-9437-9c4e8bcbbc4d tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:33.081477 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a565d92c-f782-4204-a41a-d4f1253f4411 req-30863778-454b-4fce-9437-9c4e8bcbbc4d tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 945 time: 0.3355949
May 25 16:39:33.082694 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Made reservation on behalf of 2441ab18acee4d4c9e276ba69a458348 for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:39:33.086329 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:33.248280 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a565d92c-f782-4204-a41a-d4f1253f4411 req-93afcaa2-5453-41a4-ac06-1699c43538eb tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1507900
May 25 16:39:33.344816 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b01901-c554-4b6b-af37-09bdd4c21ff6 req-54765549-8096-4328-bd93-f97cc9a1cb44 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:33.346376 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-10b01901-c554-4b6b-af37-09bdd4c21ff6 req-54765549-8096-4328-bd93-f97cc9a1cb44 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.2478631
May 25 16:39:33.387412 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Allocated IP 172.20.0.3 (e55be10d-206c-4bb4-8273-c9b859b11a42/c4c2aef1-f957-410f-9038-a1d13568aa6e/124d05f4-1b92-4b0c-8e3b-05ecdf7db82e) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:39:33.424966 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-10b01901-c554-4b6b-af37-09bdd4c21ff6 req-fcb3a335-c84f-42c0-847d-04ff7a92782b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0665410
May 25 16:39:33.441226 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:33.667693 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:33.734722 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:33.740781 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c301efac-836a-4caa-b3a3-79f249f92e0f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:33.753455 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['39034fee-da76-49d9-a359-2be89ce60575', 'dc96a24c-e6ea-4174-9a11-ac0ae925b8fb', '7b0a5381-d69e-445c-9ee0-f4004f815424'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:39:33.817470 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b282ed4c-c08e-42c2-b6d8-2f4dff842b6c None None] Network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:39:33.844209 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Network e55be10d-206c-4bb4-8273-c9b859b11a42 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:39:33.848363 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:33.855523 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Pushing event updated for resources: {'Port': ['ID=124d05f4-1b92-4b0c-8e3b-05ecdf7db82e,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:33.858063 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:39:33.891047 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:33.921471 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-506962', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-501218'] for router, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:33.934432 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:33.935089 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:33.963382 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1802781
May 25 16:39:33.988453 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Request body: {'port': {'device_id': '207381c7-af2d-4515-9ed9-8e1fb121ef03', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:34.022606 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:34.051350 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-0e79e430-5a71-44b0-9890-ab4584669945 None None] Provisioning for port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:34.200111 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-a2bebc7e-54ca-42cd-b775-bb561c01f020 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:34.200358 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Router d9f2f836-a3d4-438f-9259-98d8faf7dddd is scheduled to L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 with binding_index 1 {{(pid=92012) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 16:39:34.271230 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:34.376299 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abb050d-665a-4c92-8e20-40b928e5f1ef req-41f48263-62bf-4262-8d1e-caf0a5e561a0 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:34.376702 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-9abb050d-665a-4c92-8e20-40b928e5f1ef req-41f48263-62bf-4262-8d1e-caf0a5e561a0 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Synchronizing usage tracker for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:39:34.472082 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:39:34.485125 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Sync routers for ids ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:39:34.510610 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Routers {'d9f2f836-a3d4-438f-9259-98d8faf7dddd'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:39:34.511518 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bafcca0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:39:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:34.561557 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-9abb050d-665a-4c92-8e20-40b928e5f1ef req-41f48263-62bf-4262-8d1e-caf0a5e561a0 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Unset dirty status for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:39:34.565891 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9abb050d-665a-4c92-8e20-40b928e5f1ef req-41f48263-62bf-4262-8d1e-caf0a5e561a0 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 931 time: 0.4201846
May 25 16:39:34.574280 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Notify callbacks [] for router, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:34.586347 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] 10.222.0.73 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 3.1273279
May 25 16:39:34.587233 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54744) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:34.702903 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9abb050d-665a-4c92-8e20-40b928e5f1ef req-c362c380-7624-47c4-afc6-1ba296042c92 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1334488
May 25 16:39:34.728089 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b8346e9-dc42-499a-b592-d8980d2489eb req-2cd6aa59-decb-4f4f-b30a-95ee24c3bf9a tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:34.729569 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-5b8346e9-dc42-499a-b592-d8980d2489eb req-2cd6aa59-decb-4f4f-b30a-95ee24c3bf9a tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.76 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 945 time: 0.2440410
May 25 16:39:34.804915 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Set router d9f2f836-a3d4-438f-9259-98d8faf7dddd gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:39:35.042481 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:39:35.053712 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.056077 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.078986 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:35.096771 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Transition to ACTIVE for port object 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:35.158204 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.178901 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:35.214594 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:35.221114 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:35.222247 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.256174 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bafcca0>, [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:39:33Z', 'revision_number': 3, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port': {'id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:a9:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:32Z', 'updated_at': '2021-05-25T16:39:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:35.261034 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Checking router: d9f2f836-a3d4-438f-9259-98d8faf7dddd for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:39:35.261386 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Updating router d9f2f836-a3d4-438f-9259-98d8faf7dddd port ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec binding host dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:39:35.279932 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-5b8346e9-dc42-499a-b592-d8980d2489eb req-a9bd52c0-d0c6-4ce8-902d-a97876f730a0 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Deleting port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:39:35.280539 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-5b8346e9-dc42-499a-b592-d8980d2489eb req-a9bd52c0-d0c6-4ce8-902d-a97876f730a0 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.321038 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-524cdcc2-9bdc-48d8-9d8f-caded3e07078 req-f1291093-d472-4667-bfb9-4d2d920416ea tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:35.322504 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-524cdcc2-9bdc-48d8-9d8f-caded3e07078 req-f1291093-d472-4667-bfb9-4d2d920416ea tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 945 time: 0.8734877
May 25 16:39:35.323280 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.368502 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.412024 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:35.417139 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.430054 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:35.478413 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Pushing event updated for resources: {'Port': ['ID=124d05f4-1b92-4b0c-8e3b-05ecdf7db82e,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:35.495982 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.317s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:35.524630 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:35.527961 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:35.528912 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d019b9d6-0abc-4462-8c10-ed46e5a945dc req-506994db-d586-488f-b8b5-29bd897f495c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:35.535938 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d019b9d6-0abc-4462-8c10-ed46e5a945dc req-506994db-d586-488f-b8b5-29bd897f495c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.4268303
May 25 16:39:35.566884 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-524cdcc2-9bdc-48d8-9d8f-caded3e07078 req-5abb8424-9084-4db5-afa8-609862aae106 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2065918
May 25 16:39:35.594271 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-5b8346e9-dc42-499a-b592-d8980d2489eb req-a9bd52c0-d0c6-4ce8-902d-a97876f730a0 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] For port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=39b46d73-ca0c-4ca9-aacd-da8695a0eb59,segment=NetworkSegment(73d0d26b-c8b0-4163-b874-267f21730cc2),segment_id=73d0d26b-c8b0-4163-b874-267f21730cc2)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:35.594637 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-5b8346e9-dc42-499a-b592-d8980d2489eb req-a9bd52c0-d0c6-4ce8-902d-a97876f730a0 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.633544 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d019b9d6-0abc-4462-8c10-ed46e5a945dc req-b0ddd6a7-691e-40a4-8966-02dc894dd87b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0966949
May 25 16:39:35.634438 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Attempting to bind port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:39:35.634773 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Attempting to bind port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:39:35.635103 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Attempting to bind port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e on network e55be10d-206c-4bb4-8273-c9b859b11a42 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:35.640345 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e on network e55be10d-206c-4bb4-8273-c9b859b11a42 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:39:35.640666 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Attempting to bind port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e on network e55be10d-206c-4bb4-8273-c9b859b11a42 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:35.646083 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 39, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:39:35.646418 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Checking segment: {'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:39:35.646796 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Bound using segment: {'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:39:35.647275 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Bound port: 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:39:35.647627 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.740388 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-5b8346e9-dc42-499a-b592-d8980d2489eb req-a9bd52c0-d0c6-4ce8-902d-a97876f730a0 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Calling delete_port for 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 owned by compute:nova {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:39:35.762601 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] For port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:39:35.766018 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] For port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=124d05f4-1b92-4b0c-8e3b-05ecdf7db82e,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:39:35.774325 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.779613 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-db52e0a6-70fb-4d6b-b423-cfe7b92996f2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:35.785876 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Notify callbacks [] for port, precommit_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.798792 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.provisioning_blocks [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Transition to ACTIVE for port object ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec will not be triggered until provisioned by entity L2. {{(pid=92015) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:35.810295 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.816890 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:35.853313 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:35.853664 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.854947 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] 10.222.0.76 "PUT /v2.0/ports/124d05f4-1b92-4b0c-8e3b-05ecdf7db82e HTTP/1.1" status: 200  len: 1093 time: 1.8784616
May 25 16:39:35.856098 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '207381c7-af2d-4515-9ed9-8e1fb121ef03', 'tag': '124d05f4-1b92-4b0c-8e3b-05ecdf7db82e'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:39:35.923145 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Attempting to bind port ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:39:35.923642 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Attempting to bind port ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:39:35.924121 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Attempting to bind port ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec on network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:35.930559 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '207381c7-af2d-4515-9ed9-8e1fb121ef03', 'tag': '124d05f4-1b92-4b0c-8e3b-05ecdf7db82e', 'status': 'completed', 'code': 200}
May 25 16:39:35.934562 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd064559-2bc0-4ed0-a7f3-7360e97a2bb3 None None] Pushing event updated for resources: {'Port': ['ID=ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec,revision_number=2']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:35.937919 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-dd064559-2bc0-4ed0-a7f3-7360e97a2bb3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:35.940065 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 39, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:39:35.940568 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Checking segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92015) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:39:35.941066 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:35.941577 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Bound using segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:39:35.942652 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Bound port: ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:39:35.942652 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:36.012026 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Pushing event updated for resources: {'Port': ['ID=124d05f4-1b92-4b0c-8e3b-05ecdf7db82e,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:36.018799 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:36.033733 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] For port ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92015) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:39:36.037030 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] For port ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92015) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:39:36.043439 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:36.049457 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-e9dea955-d6aa-4bf4-acf3-98d2620e2f8e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:36.068289 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:36.080974 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a141fb10-d3a5-4a37-88e9-ad9e1499cd59 req-a81c7934-ce92-419e-a554-9c24debf01ae tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:36.083085 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a141fb10-d3a5-4a37-88e9-ad9e1499cd59 req-a81c7934-ce92-419e-a554-9c24debf01ae tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 943 time: 0.2343783
May 25 16:39:36.089440 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b73215d-990a-4d22-9107-d0f6e50efced req-c83c3f21-e6de-4155-9cb5-fa14e41f6256 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:36.090911 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-c83c3f21-e6de-4155-9cb5-fa14e41f6256 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=2441ab18acee4d4c9e276ba69a458348&device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 1096 time: 0.1595309
May 25 16:39:36.146630 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd064559-2bc0-4ed0-a7f3-7360e97a2bb3 None None] Pushing event updated for resources: {'Port': ['ID=ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec,revision_number=3']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:36.150194 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-5b8346e9-dc42-499a-b592-d8980d2489eb req-a9bd52c0-d0c6-4ce8-902d-a97876f730a0 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:36.156586 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Routers {'d9f2f836-a3d4-438f-9259-98d8faf7dddd'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:39:36.157337 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bafcca0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:39:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:36.158103 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2e503555-8f23-404f-8183-15d6db07095a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:36.167727 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['39b46d73-ca0c-4ca9-aacd-da8695a0eb59'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:39:36.176333 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-df785546-8171-48df-a288-5d8bde48f370 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=124d05f4-1b92-4b0c-8e3b-05ecdf7db82e HTTP/1.1" status: 200  len: 217 time: 0.0707581
May 25 16:39:36.219351 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9bd52c0-d0c6-4ce8-902d-a97876f730a0 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Pushing event deleted for resources: {'Port': ['ID=39b46d73-ca0c-4ca9-aacd-da8695a0eb59,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:36.222349 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a9bd52c0-d0c6-4ce8-902d-a97876f730a0 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:36.243864 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-dd064559-2bc0-4ed0-a7f3-7360e97a2bb3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:36.281175 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a141fb10-d3a5-4a37-88e9-ad9e1499cd59 req-02057c6a-ba3a-4c6a-bcca-a86c87c5045b tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1800911
May 25 16:39:36.303059 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b73215d-990a-4d22-9107-d0f6e50efced req-f3e3b74a-169b-4892-a9e0-a92c270adf95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:36.304497 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-f3e3b74a-169b-4892-a9e0-a92c270adf95 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c4c2aef1-f957-410f-9038-a1d13568aa6e HTTP/1.1" status: 200  len: 854 time: 0.1039543
May 25 16:39:36.353648 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [req-5b8346e9-dc42-499a-b592-d8980d2489eb req-a9bd52c0-d0c6-4ce8-902d-a97876f730a0 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] No DVR routers for this DVR port 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 on host hv-cinder-78638 {{(pid=92012) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:39:36.357188 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-f6a0d8b1-b142-427d-97c1-9f43604ee184 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e55be10d-206c-4bb4-8273-c9b859b11a42&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0452535
May 25 16:39:36.366740 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-5b8346e9-dc42-499a-b592-d8980d2489eb req-a9bd52c0-d0c6-4ce8-902d-a97876f730a0 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:36.369799 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72', 'name': 'network-vif-deleted', 'tag': '39b46d73-ca0c-4ca9-aacd-da8695a0eb59'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:39:36.423008 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] Set router d9f2f836-a3d4-438f-9259-98d8faf7dddd gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:39:36.436077 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-5b8346e9-dc42-499a-b592-d8980d2489eb req-a9bd52c0-d0c6-4ce8-902d-a97876f730a0 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.76 "DELETE /v2.0/ports/39b46d73-ca0c-4ca9-aacd-da8695a0eb59 HTTP/1.1" status: 204  len: 173 time: 1.6898727
May 25 16:39:36.446720 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72', 'name': 'network-vif-deleted', 'tag': '39b46d73-ca0c-4ca9-aacd-da8695a0eb59', 'status': 'completed', 'code': 200}
May 25 16:39:36.467999 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Allocated IP 172.20.0.1 (3e40698a-e2cb-4812-9711-e3b481dbc8b3/6203ecab-ef7b-4872-ac7a-33ea4cfae323/beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:39:36.563550 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:36.689586 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-2e339942-11a7-4ac0-8917-e8037e62ca15 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3242707
May 25 16:39:36.801011 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bafcca0>, [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:39:33Z', 'revision_number': 3, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port': {'id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:a9:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:32Z', 'updated_at': '2021-05-25T16:39:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:36.806158 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-006680a4-84b4-4b1a-8055-ce94e2a07bb9 None None] The sync data for ids ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'] in dv-cinder-786386-6-iscsi is: [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:39:33Z', 'revision_number': 3, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port': {'id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:a9:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:32Z', 'updated_at': '2021-05-25T16:39:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:39:36.817495 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:36.839526 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Transition to ACTIVE for port object beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd will not be triggered until provisioned by entity DHCP. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:36.865940 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:36.870677 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:36.881287 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-28e24882-96b1-426c-b078-743eff3274cd req-ead2e9d6-41e6-416c-8dcb-9a8c5b05965f tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=a5a1d440-6e7d-4ff0-8c1c-628aaeb36c72 HTTP/1.1" status: 200  len: 210 time: 0.1081023
May 25 16:39:36.948754 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b73215d-990a-4d22-9107-d0f6e50efced req-bbdc2924-b7f8-40d3-983a-3dda84b873c9 service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2524762
May 25 16:39:36.981113 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:39:36.985382 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:36.989937 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:39:36.990485 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebd91a95-09b1-4c7f-b316-d5044975a992 req-9921189f-2c10-4359-9807-7a8f48c7ef39 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:36.992058 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ebd91a95-09b1-4c7f-b316-d5044975a992 req-9921189f-2c10-4359-9807-7a8f48c7ef39 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1662140
May 25 16:39:37.034447 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:37.089532 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Pushing event updated for resources: {'Port': ['ID=beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:37.115179 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:37.145755 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-501395'] for router_interface, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:37.174175 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ebd91a95-09b1-4c7f-b316-d5044975a992 req-c3d16ca6-101a-495f-b68f-3508e749b0f9 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1537056
May 25 16:39:37.213008 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:37.213526 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:37.231864 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8d1cc3-09ac-44df-85ff-ae1ec30c162d req-a98fa7cb-d039-4a77-87a6-246828e57f1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:37.233469 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bb8d1cc3-09ac-44df-85ff-ae1ec30c162d req-a98fa7cb-d039-4a77-87a6-246828e57f1b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=2441ab18acee4d4c9e276ba69a458348&device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 1096 time: 0.1684690
May 25 16:39:37.423317 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:37.551873 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-192e1c5d-c23e-46d0-93f3-b8512d2c99e1 None None] Provisioning for port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:37.560189 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-192e1c5d-c23e-46d0-93f3-b8512d2c99e1 None None] Provisioning complete for port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:37.560693 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-192e1c5d-c23e-46d0-93f3-b8512d2c99e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:37.564551 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8d1cc3-09ac-44df-85ff-ae1ec30c162d req-f6fb237b-8690-44cd-b1e2-d12f3b184670 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:37.566038 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bb8d1cc3-09ac-44df-85ff-ae1ec30c162d req-f6fb237b-8690-44cd-b1e2-d12f3b184670 service neutron] 10.222.0.76 "GET /v2.0/networks?id=e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 200  len: 915 time: 0.3223054
May 25 16:39:37.656774 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bb8d1cc3-09ac-44df-85ff-ae1ec30c162d req-28b52fac-eb7a-4750-8279-1282fd60e170 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=124d05f4-1b92-4b0c-8e3b-05ecdf7db82e HTTP/1.1" status: 200  len: 217 time: 0.0779808
May 25 16:39:37.663062 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-192e1c5d-c23e-46d0-93f3-b8512d2c99e1 None None] Port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:39:37.740107 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1b1cdaf-d58b-4660-a344-cee7f9b66848 req-cb10f274-83af-4ae5-83ce-1bdbe1508a62 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:37.743749 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d1b1cdaf-d58b-4660-a344-cee7f9b66848 req-cb10f274-83af-4ae5-83ce-1bdbe1508a62 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 943 time: 0.2616222
May 25 16:39:37.754205 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8d1cc3-09ac-44df-85ff-ae1ec30c162d req-7584d8e9-571d-4ed6-815c-aa3b963bbfe4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:37.755617 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bb8d1cc3-09ac-44df-85ff-ae1ec30c162d req-7584d8e9-571d-4ed6-815c-aa3b963bbfe4 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=c4c2aef1-f957-410f-9038-a1d13568aa6e HTTP/1.1" status: 200  len: 854 time: 0.0872016
May 25 16:39:37.757495 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:37.765236 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:37.795937 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:37.819904 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bb8d1cc3-09ac-44df-85ff-ae1ec30c162d req-1ddae1e4-e0d3-4e01-94d2-097b1f34e865 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=e55be10d-206c-4bb4-8273-c9b859b11a42&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0486653
May 25 16:39:37.884369 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630485', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-501310'] for router_interface, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:37.887677 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Pushing event updated for resources: {'Port': ['ID=beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:37.891122 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:37.920461 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d1b1cdaf-d58b-4660-a344-cee7f9b66848 req-f53df241-3d7a-4355-b641-2f11c400826e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1712265
May 25 16:39:37.981826 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bb8d1cc3-09ac-44df-85ff-ae1ec30c162d req-5cb405b7-e909-43f0-bac1-922aaf04fe7b service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1541531
May 25 16:39:38.071042 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:39:38.072324 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:38.155707 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:39:38.164116 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bb8d1cc3-09ac-44df-85ff-ae1ec30c162d req-0f78d4f9-ad92-4044-8293-c3137914a32d service neutron] 10.222.0.76 "GET /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1692662
May 25 16:39:38.221892 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:39:38.222350 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 39b46d73-ca0c-4ca9-aacd-da8695a0eb59 not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:39:38.325940 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Router d9f2f836-a3d4-438f-9259-98d8faf7dddd has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:39:38.392536 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-319743b4-b14c-4fc6-9e90-525ba499edc4 None None] Provisioning complete for port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:38.393132 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-319743b4-b14c-4fc6-9e90-525ba499edc4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:38.461725 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-319743b4-b14c-4fc6-9e90-525ba499edc4 None None] Port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:39:38.498374 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-5635ec8d-a718-408d-878a-143b398bb9e4 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:38.500111 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-5635ec8d-a718-408d-878a-143b398bb9e4 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/networks?id=5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 HTTP/1.1" status: 200  len: 806 time: 0.2373142
May 25 16:39:38.517685 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:39:38.524146 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] 10.222.0.73 "PUT /v2.0/routers/d9f2f836-a3d4-438f-9259-98d8faf7dddd/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.9347715
May 25 16:39:38.528163 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-fe36e830-9417-49a9-80f7-c58e42229c88 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/quotas/73cf5a2c98e64235b56c6c8b43e872f5 HTTP/1.1" status: 200  len: 375 time: 0.0184188
May 25 16:39:38.591801 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9af78586-041c-4d4a-91d9-411a915b5e46 req-f5ee9f7a-b7df-4d29-bb10-084cedd4c9a5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:38.593298 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9af78586-041c-4d4a-91d9-411a915b5e46 req-f5ee9f7a-b7df-4d29-bb10-084cedd4c9a5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1666930
May 25 16:39:38.595501 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-7419c70c-d34c-47d6-8fa1-8b62f38d423d tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=73cf5a2c98e64235b56c6c8b43e872f5&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0594330
May 25 16:39:38.813700 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Sync routers for ids ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:39:38.819892 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9af78586-041c-4d4a-91d9-411a915b5e46 req-48563ce5-be77-4ced-8b7a-29998d2c0a3c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2178493
May 25 16:39:38.825771 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Routers {'d9f2f836-a3d4-438f-9259-98d8faf7dddd'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:39:38.826402 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bae14f0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:39:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:38.871476 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-68d712e2-7f95-4be4-8cdf-56f97b246eee service neutron] 10.222.0.73 "GET /v2.0/networks/5782c094-7ba9-4a97-a5bd-3f5f0a0557b0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2683463
May 25 16:39:39.035320 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-489b0f83-8a30-46d8-a18e-ea40f3ef615e service neutron] 10.222.0.73 "GET /v2.0/networks/5782c094-7ba9-4a97-a5bd-3f5f0a0557b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1575112
May 25 16:39:39.060743 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:39.107295 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Set router d9f2f836-a3d4-438f-9259-98d8faf7dddd gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:39:39.166694 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36ce3e4-9676-499d-8e83-d7f500716acc req-5417a71f-4492-416e-be07-e8b909060939 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:39.166694 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d36ce3e4-9676-499d-8e83-d7f500716acc req-5417a71f-4492-416e-be07-e8b909060939 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 943 time: 0.0981259
May 25 16:39:39.217760 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54810) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:39.224671 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1530563751-network', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:39.229631 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d36ce3e4-9676-499d-8e83-d7f500716acc req-5d248c7a-2500-4315-9a1b-372f4d800b61 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0543466
May 25 16:39:39.237346 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:39.246547 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Usage tracker for resource:network and tenant:3aa35a088d0242458aafe4c1b207fec3 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:39.250011 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:39.256152 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:39.275232 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Made reservation on behalf of 3aa35a088d0242458aafe4c1b207fec3 for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:39:39.277643 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:39.291161 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:39.308415 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:39.311869 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-72404764-af07-41bf-99f2-9dcfb27185ff req-f49164f8-c5ea-4e74-a61e-f09eb384a714 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 210 time: 0.0729558
May 25 16:39:39.326394 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Usage tracker for resource:security_group_rule and tenant:3aa35a088d0242458aafe4c1b207fec3 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:39.330451 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:39.349113 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:39.433761 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:39.463294 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:39.464410 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:39.464793 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:39.471219 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:39.475586 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2a03501b-b6cf-42d8-9fb3-2cefdcc06f9d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:39.502533 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 429}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:39:39.510057 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:39:39.516787 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d08640ca-c07d-444d-a190-5c5294062f76,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:39.527859 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:39.529304 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:39.529888 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Added segment 80d0c339-d557-4898-a197-cde1821f5d83 of type vlan for network ca530aa1-a332-4315-a736-76ee81fb8b29
May 25 16:39:39.565119 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:39.611364 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:39.615174 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:39.615986 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:39.622016 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:39.684217 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:39.690853 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bae14f0>, [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:39:37Z', 'revision_number': 4, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port': {'id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:a9:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:32Z', 'updated_at': '2021-05-25T16:39:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd', 'name': '', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'mac_address': 'fa:16:3e:5a:26:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_interface', 'standard_attr_id': 377, 'fixed_ips': [{'subnet_id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:36Z', 'updated_at': '2021-05-25T16:39:37Z', 'revision_number': 2, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'subnets': [{'id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:39.701448 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Checking router: d9f2f836-a3d4-438f-9259-98d8faf7dddd for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:39:39.701943 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Updating router d9f2f836-a3d4-438f-9259-98d8faf7dddd port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd binding host dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:39:39.748605 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Pushing event updated for resources: {'Network': ['ID=ca530aa1-a332-4315-a736-76ee81fb8b29,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:39.753148 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:39.754989 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.5361853
May 25 16:39:39.758103 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54824) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:39.764779 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Request body: {'subnet': {'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1530563751-subnet', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'ip_version': 4}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:39.765275 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:39.772182 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:39.777786 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Usage tracker for resource:subnet and tenant:3aa35a088d0242458aafe4c1b207fec3 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:39.782964 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network ca530aa1-a332-4315-a736-76ee81fb8b29 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:39:39.790813 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:39.797715 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:39.802634 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:39.806661 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-292da708-73e3-4911-98fd-3451155cda41 req-9c6ddf19-4164-4c7d-bf5e-cbf273390153 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1344507
May 25 16:39:39.809613 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:39.822866 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Made reservation on behalf of 3aa35a088d0242458aafe4c1b207fec3 for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:39:39.825367 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-697612'] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:39.955659 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292da708-73e3-4911-98fd-3451155cda41 req-b42bc0fd-12d1-4bd6-81c2-43ff87f50562 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:39.957577 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-292da708-73e3-4911-98fd-3451155cda41 req-b42bc0fd-12d1-4bd6-81c2-43ff87f50562 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fe57668427364ea7acb08a0f7f2826ed&device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 1099 time: 0.1207640
May 25 16:39:39.989183 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:40.012933 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:40.030787 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:40.163344 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:39:40.213678 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e5086ca-ed60-4614-bb30-11047a12cc99 req-941f8d4e-3fed-4d48-a78b-6f49246f72b2 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:40.215142 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9e5086ca-ed60-4614-bb30-11047a12cc99 req-941f8d4e-3fed-4d48-a78b-6f49246f72b2 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.2517281
May 25 16:39:40.217955 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292da708-73e3-4911-98fd-3451155cda41 req-ae7d5b74-5956-4a2e-8e60-4ad7c498fcc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:40.219462 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-292da708-73e3-4911-98fd-3451155cda41 req-ae7d5b74-5956-4a2e-8e60-4ad7c498fcc3 service neutron] 10.222.0.76 "GET /v2.0/networks?id=1186d694-166f-4246-b68b-e7ce60cb0f02 HTTP/1.1" status: 200  len: 918 time: 0.1864631
May 25 16:39:40.309062 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-292da708-73e3-4911-98fd-3451155cda41 req-cf18a8d2-8c9f-4386-953c-4b774440f0e4 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d HTTP/1.1" status: 200  len: 217 time: 0.0717587
May 25 16:39:40.354986 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7721570', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-697626'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:40.359330 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-9b87cd4b-796f-4f8a-b1a5-0fccae3c127e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:40.367998 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9e5086ca-ed60-4614-bb30-11047a12cc99 req-b6700cce-5a19-4533-a6d1-d5a2922a9f88 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1440961
May 25 16:39:40.409431 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292da708-73e3-4911-98fd-3451155cda41 req-a9a51cfa-64b6-4fb5-a6ef-30e5c3605058 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:40.410882 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-292da708-73e3-4911-98fd-3451155cda41 req-a9a51cfa-64b6-4fb5-a6ef-30e5c3605058 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5e6146eb-31ff-437b-a594-8ddb1d63042e HTTP/1.1" status: 200  len: 857 time: 0.0857337
May 25 16:39:40.453165 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Pushing event updated for resources: {'Subnet': ['ID=c6bfd6f1-5436-48ae-aff5-b61d9efcb1da,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:40.479211 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:40.494245 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Checking segment: {'id': '80d0c339-d557-4898-a197-cde1821f5d83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 429, 'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:39:40.494619 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Network hostable DHCP agents. Network: ca530aa1-a332-4315-a736-76ee81fb8b29, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:39:40.519654 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-292da708-73e3-4911-98fd-3451155cda41 req-f21c3296-48f8-4963-a55c-ab7c227a62f7 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=1186d694-166f-4246-b68b-e7ce60cb0f02&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0675104
May 25 16:39:40.527058 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Network ca530aa1-a332-4315-a736-76ee81fb8b29 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:39:40.542187 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, ca530aa1-a332-4315-a736-76ee81fb8b29) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:40.560804 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Notify callbacks [] for port, precommit_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:40.561871 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-943062e8-dda5-4e6a-8e70-8a73715cd7ef None None] Network ca530aa1-a332-4315-a736-76ee81fb8b29 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:39:40.566429 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:40.568013 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:40.605419 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-df7c70e2-6d6a-4e13-9da3-03b2a18ebd9c admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.8452351
May 25 16:39:40.631867 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54836) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:40.643557 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1530563751-router', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:40.645387 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Transition to ACTIVE for port object beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:40.672094 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:40.681437 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:40.718292 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:40.735735 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Usage tracker for resource:router and tenant:3aa35a088d0242458aafe4c1b207fec3 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:40.744152 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=124d05f4-1b92-4b0c-8e3b-05ecdf7db82e,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:40.751227 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:40.763024 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f218e191-91b3-4291-a15a-7ca340a952d2 req-1e547bd9-5c9d-4141-912b-24082a6143a4 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 210 time: 0.2415001
May 25 16:39:40.766340 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:40.819875 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-292da708-73e3-4911-98fd-3451155cda41 req-448dd3f2-cf2d-48ac-a22e-d142eee83b67 service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2483864
May 25 16:39:40.832174 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc399416-0d34-498c-bc1a-2689bb39aa0a req-c94e0934-5db4-4d46-9ca6-777ccebc9c7d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:40.842964 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dc399416-0d34-498c-bc1a-2689bb39aa0a req-c94e0934-5db4-4d46-9ca6-777ccebc9c7d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 943 time: 0.4307458
May 25 16:39:40.844672 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '124d05f4-1b92-4b0c-8e3b-05ecdf7db82e', 'network_id': 'e55be10d-206c-4bb4-8273-c9b859b11a42', 'port_id': '124d05f4-1b92-4b0c-8e3b-05ecdf7db82e', 'mac_address': 'fa:16:3e:ae:0b:2f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 410, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c4c2aef1-f957-410f-9038-a1d13568aa6e', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:39:40.869280 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-506971', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2375'] for router, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:40.871610 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-504667', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-501124', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1593705', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2380'] for router, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:40.879977 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a08e0089-1502-441f-956b-aa0553a8002b None None] Pushing event updated for resources: {'Port': ['ID=beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:40.901434 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-a08e0089-1502-441f-956b-aa0553a8002b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:40.987944 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:41.028009 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-44f059a7-9e0f-46e5-a38a-2a0faef2632d tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:41.029835 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-44f059a7-9e0f-46e5-a38a-2a0faef2632d tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Synchronizing usage tracker for tenant:73cf5a2c98e64235b56c6c8b43e872f5 on resource:network {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:39:41.081843 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dc399416-0d34-498c-bc1a-2689bb39aa0a req-83684a07-1c68-4477-b8e4-ba5daad2bbb4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1962309
May 25 16:39:41.134531 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:41.169219 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-292da708-73e3-4911-98fd-3451155cda41 req-dbc427c9-c1f4-49e2-8c3e-2a7ce8881014 service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3252800
May 25 16:39:41.177868 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:41.187922 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-44f059a7-9e0f-46e5-a38a-2a0faef2632d tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Unset dirty status for tenant:73cf5a2c98e64235b56c6c8b43e872f5 on resource:network {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:39:41.189227 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-44f059a7-9e0f-46e5-a38a-2a0faef2632d tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.76 "GET /v2.0/networks?id=5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 HTTP/1.1" status: 200  len: 806 time: 0.5824201
May 25 16:39:41.253970 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Request body: {'port': {'device_id': '51c62c09-ee75-47af-aa31-03e6a0bcdb5d', 'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0', 'admin_state_up': True, 'tenant_id': '73cf5a2c98e64235b56c6c8b43e872f5'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:41.298807 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:39:41.303364 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d60576c-5158-50e8-99d6-6272b1af5e3f-ca530aa1-a332-4315-a736-76ee81fb8b29', 'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'fixed_ips': [{'subnet_id': 'c6bfd6f1-5436-48ae-aff5-b61d9efcb1da'}]}} from dv-cinder-786386-6-iscsi. {{(pid=92014) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 16:39:41.305083 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:41.363221 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Attempting to bind port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:39:41.363596 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Attempting to bind port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '19ecc07e-d399-4943-af92-0daf09e9ec93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 401, 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:39:41.363957 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Attempting to bind port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd on network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:41.413047 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=124d05f4-1b92-4b0c-8e3b-05ecdf7db82e,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:41.416877 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 39, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:39:41.417270 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Checking segment: {'id': '19ecc07e-d399-4943-af92-0daf09e9ec93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 401, 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:39:41.417681 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:41.418076 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Bound using segment: {'id': '19ecc07e-d399-4943-af92-0daf09e9ec93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 401, 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:39:41.418973 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Bound port: beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '19ecc07e-d399-4943-af92-0daf09e9ec93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 401, 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:39:41.419356 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:41.439999 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:41.449440 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:41.477489 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-501153', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-506985', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2362'] for router, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:41.594285 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b7b513e-f73c-455b-b1c1-2bf55ef2ae1e req-7d421139-e41c-49a3-adc0-81018cb0a3d0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:41.595567 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:41.595957 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6b7b513e-f73c-455b-b1c1-2bf55ef2ae1e req-7d421139-e41c-49a3-adc0-81018cb0a3d0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0916672
May 25 16:39:41.602073 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Usage tracker for resource:port and tenant:73cf5a2c98e64235b56c6c8b43e872f5 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:41.606691 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:41.617788 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:41.624122 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:41.624971 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:41.631505 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Made reservation on behalf of 73cf5a2c98e64235b56c6c8b43e872f5 for: {'port': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:39:41.635081 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:41.655606 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6b7b513e-f73c-455b-b1c1-2bf55ef2ae1e req-d98f3c42-c9b0-4f42-8e96-71770be09f22 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0495269
May 25 16:39:41.684043 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=124d05f4-1b92-4b0c-8e3b-05ecdf7db82e,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:41.716288 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:41.749571 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.db_base_plugin_common [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Allocated IP 172.20.0.2 (ca530aa1-a332-4315-a736-76ee81fb8b29/c6bfd6f1-5436-48ae-aff5-b61d9efcb1da/e14194d6-6e64-4ab6-8cc7-b801cf1c0174) {{(pid=92014) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:39:41.752266 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] For port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:39:41.764298 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] For port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:39:41.772047 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:41.778175 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:41.818565 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['124d05f4-1b92-4b0c-8e3b-05ecdf7db82e'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:39:41.938669 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9cb2bcb1-ac1f-4cf3-9047-bb8559a31cfd req-721229b7-c70b-42a5-91b3-ecfd4f7b04df tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 210 time: 0.0467658
May 25 16:39:42.082758 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a08e0089-1502-441f-956b-aa0553a8002b None None] Pushing event updated for resources: {'Port': ['ID=beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:42.086694 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-a08e0089-1502-441f-956b-aa0553a8002b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.308s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:42.113910 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Routers {'d9f2f836-a3d4-438f-9259-98d8faf7dddd'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:39:42.115205 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bae14f0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:39:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:42.124727 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Allocated IP 172.20.0.6 (5782c094-7ba9-4a97-a5bd-3f5f0a0557b0/4030a70d-20ce-4ddd-ab1c-d1d794468e8e/40870ff6-bd4b-41c1-a37d-1ccf6f7c2406) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:39:42.160989 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:42.256277 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:42.593085 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:42.602538 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Notify callbacks [] for port, precommit_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:42.623947 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Transition to ACTIVE for port object e14194d6-6e64-4ab6-8cc7-b801cf1c0174 will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:42.624555 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Allocated IP 172.27.3.232 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/d7227a1e-9b2e-47b8-9143-9c7dbed387f2) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:39:42.629561 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] Set router d9f2f836-a3d4-438f-9259-98d8faf7dddd gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:39:42.713886 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ab9ca4c-8ccc-4130-aef8-e08fb284d709 req-77f03ba8-2d71-4386-93e7-c09e97f9672f tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:42.714655 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Transition to ACTIVE for port object e14194d6-6e64-4ab6-8cc7-b801cf1c0174 will not be triggered until provisioned by entity DHCP. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:42.721132 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0ab9ca4c-8ccc-4130-aef8-e08fb284d709 req-77f03ba8-2d71-4386-93e7-c09e97f9672f tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 944 time: 0.4182673
May 25 16:39:42.766980 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:42.775841 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3e48ac9-bf58-47c6-b91a-25506be35e33 req-d0e0bcf1-11f3-4b85-9371-be7fc28ec4ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:42.777455 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e3e48ac9-bf58-47c6-b91a-25506be35e33 req-d0e0bcf1-11f3-4b85-9371-be7fc28ec4ea service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fe57668427364ea7acb08a0f7f2826ed&device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 1099 time: 0.2127764
May 25 16:39:42.780624 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:42.785765 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:42.788274 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0ab9ca4c-8ccc-4130-aef8-e08fb284d709 req-4f04c43e-0f2e-47fb-ab61-2bb2a3ca1c2d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0658460
May 25 16:39:42.795082 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:42.844221 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da512381-73b4-4e51-8ad8-2adcb5ab4258 req-30a319f6-2c35-4ebb-b7fc-57102b712528 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:42.845932 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-da512381-73b4-4e51-8ad8-2adcb5ab4258 req-30a319f6-2c35-4ebb-b7fc-57102b712528 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.2093093
May 25 16:39:42.851658 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Network ca530aa1-a332-4315-a736-76ee81fb8b29 is already hosted by enough agents. {{(pid=92014) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:39:42.854679 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Network 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:39:42.861311 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:42.864635 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:39:42.866647 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.base_scheduler [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Resources bound (agent type, host, resource id):  {{(pid=92014) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:42.926124 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Received port after_create {{(pid=92014) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:39:42.939501 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Pushing event updated for resources: {'Port': ['ID=40870ff6-bd4b-41c1-a37d-1ccf6f7c2406,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:42.943040 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:42.952116 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:42.974081 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:42.974727 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:43.020586 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.7704153
May 25 16:39:43.023715 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-da512381-73b4-4e51-8ad8-2adcb5ab4258 req-c5ac7f5f-ebbd-47f6-99ea-afcc154fda42 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1275055
May 25 16:39:43.033920 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Request body: {'port': {'device_id': '51c62c09-ee75-47af-aa31-03e6a0bcdb5d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:43.075727 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3e48ac9-bf58-47c6-b91a-25506be35e33 req-e863e40f-d47d-47a5-9c26-8fcbedf4e11c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:43.077362 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e3e48ac9-bf58-47c6-b91a-25506be35e33 req-e863e40f-d47d-47a5-9c26-8fcbedf4e11c service neutron] 10.222.0.76 "GET /v2.0/networks?id=1186d694-166f-4246-b68b-e7ce60cb0f02 HTTP/1.1" status: 200  len: 918 time: 0.2875412
May 25 16:39:43.082926 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Pushing event updated for resources: {'Port': ['ID=e14194d6-6e64-4ab6-8cc7-b801cf1c0174,revision_number=1']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:43.108464 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.313s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:43.131052 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Attempting to bind port e14194d6-6e64-4ab6-8cc7-b801cf1c0174 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:39:43.131427 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Attempting to bind port e14194d6-6e64-4ab6-8cc7-b801cf1c0174 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '80d0c339-d557-4898-a197-cde1821f5d83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 429, 'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:39:43.132586 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Attempting to bind port e14194d6-6e64-4ab6-8cc7-b801cf1c0174 on network ca530aa1-a332-4315-a736-76ee81fb8b29 {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:43.144872 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:43.152859 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:43.167473 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 39, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:39:43.167851 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Checking segment: {'id': '80d0c339-d557-4898-a197-cde1821f5d83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 429, 'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:39:43.168259 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:43.168660 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Bound using segment: {'id': '80d0c339-d557-4898-a197-cde1821f5d83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 429, 'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:39:43.169122 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Bound port: e14194d6-6e64-4ab6-8cc7-b801cf1c0174, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '80d0c339-d557-4898-a197-cde1821f5d83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 429, 'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:39:43.169519 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:43.195431 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e3e48ac9-bf58-47c6-b91a-25506be35e33 req-c9d461ee-b461-4b60-a3ca-e9afe8f2cb38 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d HTTP/1.1" status: 200  len: 217 time: 0.1074617
May 25 16:39:43.231742 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:39:43.232461 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:43.259318 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20eea2d9-8cd0-4743-984c-9aa377830528 req-b040da85-42c3-4106-b3d6-5244339a5342 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:43.260954 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-20eea2d9-8cd0-4743-984c-9aa377830528 req-b040da85-42c3-4106-b3d6-5244339a5342 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.3080492
May 25 16:39:43.288310 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] For port e14194d6-6e64-4ab6-8cc7-b801cf1c0174, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:39:43.292063 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bae14f0>, [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:39:37Z', 'revision_number': 4, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port': {'id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:a9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:32Z', 'updated_at': '2021-05-25T16:39:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd', 'name': '', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'mac_address': 'fa:16:3e:5a:26:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_interface', 'standard_attr_id': 377, 'fixed_ips': [{'subnet_id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:36Z', 'updated_at': '2021-05-25T16:39:41Z', 'revision_number': 4, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'subnets': [{'id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:43.295272 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] For port e14194d6-6e64-4ab6-8cc7-b801cf1c0174, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=e14194d6-6e64-4ab6-8cc7-b801cf1c0174,segment=NetworkSegment(80d0c339-d557-4898-a197-cde1821f5d83),segment_id=80d0c339-d557-4898-a197-cde1821f5d83)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:39:43.298744 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6c82207-cdc3-4265-b2fe-d2159d7cd36d None None] The sync data for ids ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'] in dv-cinder-786386-6-iscsi is: [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:39:37Z', 'revision_number': 4, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port': {'id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:a9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:32Z', 'updated_at': '2021-05-25T16:39:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd', 'name': '', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'mac_address': 'fa:16:3e:5a:26:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_interface', 'standard_attr_id': 377, 'fixed_ips': [{'subnet_id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:36Z', 'updated_at': '2021-05-25T16:39:41Z', 'revision_number': 4, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'subnets': [{'id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:39:43.302533 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:43.310069 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:43.333214 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3e48ac9-bf58-47c6-b91a-25506be35e33 req-a4320cb0-89ae-40c0-8f95-9b913a87e103 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:43.334822 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e3e48ac9-bf58-47c6-b91a-25506be35e33 req-a4320cb0-89ae-40c0-8f95-9b913a87e103 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5e6146eb-31ff-437b-a594-8ddb1d63042e HTTP/1.1" status: 200  len: 857 time: 0.1323123
May 25 16:39:43.360477 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-20eea2d9-8cd0-4743-984c-9aa377830528 req-99ad846a-8c28-40f9-9d4e-db8750de0a68 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0802116
May 25 16:39:43.448943 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e3e48ac9-bf58-47c6-b91a-25506be35e33 req-d3ff64ca-be9e-4367-ac08-27412b6d21fa service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=1186d694-166f-4246-b68b-e7ce60cb0f02&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0812628
May 25 16:39:43.455635 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Pushing event updated for resources: {'Port': ['ID=e14194d6-6e64-4ab6-8cc7-b801cf1c0174,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:43.465892 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:43.469605 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41616984-6a6c-406e-8131-d848f1384110 req-ef07b6e6-c76d-4b09-8731-ee7adc00ffdd tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:43.471280 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-41616984-6a6c-406e-8131-d848f1384110 req-ef07b6e6-c76d-4b09-8731-ee7adc00ffdd tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 931 time: 0.3169863
May 25 16:39:43.626344 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-41616984-6a6c-406e-8131-d848f1384110 req-199aaa4d-2a3e-4cb0-85d9-37d6bd02d6a6 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1316736
May 25 16:39:43.660433 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:43.681312 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:39:43.717871 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e3e48ac9-bf58-47c6-b91a-25506be35e33 req-3ba5578f-7805-454b-82a3-3ca03b591ae8 service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2453992
May 25 16:39:43.745514 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Pushing event updated for resources: {'Port': ['ID=d7227a1e-9b2e-47b8-9143-9c7dbed387f2,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:43.755777 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.603s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:43.774075 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 {{(pid=92012) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:39:43.788931 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:43.923036 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e3e48ac9-bf58-47c6-b91a-25506be35e33 req-90358a19-5f35-4e0f-b5ce-43944d2fbde9 service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1938190
May 25 16:39:43.970571 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Transition to ACTIVE for port object 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 will not be triggered until provisioned by entity L2. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:44.003522 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:44.014058 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:44.057250 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:44.063638 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37fce807-1f09-4db9-98b7-d87f0ecb2bc9 req-e6905d42-7072-4ef3-9a44-682d3346f77c tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:44.072496 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-37fce807-1f09-4db9-98b7-d87f0ecb2bc9 req-e6905d42-7072-4ef3-9a44-682d3346f77c tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 944 time: 0.1150286
May 25 16:39:44.133039 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-37fce807-1f09-4db9-98b7-d87f0ecb2bc9 req-4de27047-db77-4648-92a5-cedaf250fd76 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0595853
May 25 16:39:44.182040 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:44.275020 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:44.281954 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:44.282542 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:44.291443 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b81977-6ef8-46a1-83e1-89261b64bd61 req-1450caad-a23c-4880-8682-5816f7eca512 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:44.293734 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-83b81977-6ef8-46a1-83e1-89261b64bd61 req-1450caad-a23c-4880-8682-5816f7eca512 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1234612
May 25 16:39:44.378687 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-83b81977-6ef8-46a1-83e1-89261b64bd61 req-5133d672-c8a3-40b4-92b5-2f65249a7006 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0768456
May 25 16:39:44.454360 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Pushing event updated for resources: {'Port': ['ID=40870ff6-bd4b-41c1-a37d-1ccf6f7c2406,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:44.497591 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.484s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:44.513140 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:44.561176 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=124d05f4-1b92-4b0c-8e3b-05ecdf7db82e,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:44.562502 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '207381c7-af2d-4515-9ed9-8e1fb121ef03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '124d05f4-1b92-4b0c-8e3b-05ecdf7db82e'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:39:44.588007 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:44.595260 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:44.658342 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '207381c7-af2d-4515-9ed9-8e1fb121ef03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '124d05f4-1b92-4b0c-8e3b-05ecdf7db82e', 'code': 200}
May 25 16:39:44.674424 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be5ce57-adc5-4904-b933-f3dd22917c45 req-1e1d8fd7-5fae-4265-9f10-2faa4935e0c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:44.683347 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1be5ce57-adc5-4904-b933-f3dd22917c45 req-1e1d8fd7-5fae-4265-9f10-2faa4935e0c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1553419
May 25 16:39:44.698346 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Attempting to bind port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:39:44.698888 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Attempting to bind port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '73d0d26b-c8b0-4163-b874-267f21730cc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 440, 'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0'}] {{(pid=92012) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:39:44.699017 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Attempting to bind port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 on network 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:44.715604 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 on network 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:39:44.715936 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Attempting to bind port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 on network 5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:44.730798 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 39, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:39:44.731132 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Checking segment: {'id': '73d0d26b-c8b0-4163-b874-267f21730cc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 440, 'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:39:44.731565 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Bound using segment: {'id': '73d0d26b-c8b0-4163-b874-267f21730cc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 440, 'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0'} {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:39:44.732011 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Bound port: 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '73d0d26b-c8b0-4163-b874-267f21730cc2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 440, 'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0'}}] {{(pid=92012) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:39:44.732666 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:44.736058 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=124d05f4-1b92-4b0c-8e3b-05ecdf7db82e,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:44.739923 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:44.767920 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1be5ce57-adc5-4904-b933-f3dd22917c45 req-539421e0-e933-4ad7-8055-939a47b209ba tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0742826
May 25 16:39:44.829916 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:44.844860 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66794476-d88b-4538-ba88-fe98cb9092da None None] Network ca530aa1-a332-4315-a736-76ee81fb8b29 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:39:45.049234 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac8e31f4-76e5-43f3-bcc2-85fd8598438e req-930b70fe-d78e-4d8e-8a78-64b1d07537b7 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:45.055106 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ac8e31f4-76e5-43f3-bcc2-85fd8598438e req-930b70fe-d78e-4d8e-8a78-64b1d07537b7 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 943 time: 0.1377928
May 25 16:39:45.076779 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75aeca2-ae68-4539-b5ed-033b6c4aa505 req-fd2cb09c-38a2-4e6c-bc4b-9242eb63f6b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:45.078281 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a75aeca2-ae68-4539-b5ed-033b6c4aa505 req-fd2cb09c-38a2-4e6c-bc4b-9242eb63f6b5 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 1098 time: 0.1970615
May 25 16:39:45.115686 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:45.133047 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ac8e31f4-76e5-43f3-bcc2-85fd8598438e req-6ad353c1-c051-4a5d-ae14-82beb23d55d4 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0770934
May 25 16:39:45.139248 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a75aeca2-ae68-4539-b5ed-033b6c4aa505 req-558912e5-6b02-4ac0-ac35-1f7c36fab58d service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0469317
May 25 16:39:45.167954 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-ee92707d-e45f-4599-9d54-e486117002fa None None] Provisioning for port e14194d6-6e64-4ab6-8cc7-b801cf1c0174 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:45.214166 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] For port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406, host hv-cinder-78638, cleared binding levels {{(pid=92012) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:39:45.241236 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] For port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=40870ff6-bd4b-41c1-a37d-1ccf6f7c2406,segment=NetworkSegment(73d0d26b-c8b0-4163-b874-267f21730cc2),segment_id=73d0d26b-c8b0-4163-b874-267f21730cc2)] {{(pid=92012) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:39:45.246246 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:45.250155 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:45.252715 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:45.253082 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:45.257345 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:45.318615 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-506962', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-501218'] for router, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:45.324782 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:45.325429 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:45.326968 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] 10.222.0.76 "PUT /v2.0/ports/40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 HTTP/1.1" status: 200  len: 1093 time: 2.2983932
May 25 16:39:45.328530 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '51c62c09-ee75-47af-aa31-03e6a0bcdb5d', 'tag': '40870ff6-bd4b-41c1-a37d-1ccf6f7c2406'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:39:45.448320 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:45.462013 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '51c62c09-ee75-47af-aa31-03e6a0bcdb5d', 'tag': '40870ff6-bd4b-41c1-a37d-1ccf6f7c2406', 'status': 'completed', 'code': 200}
May 25 16:39:45.488902 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:45.499186 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:45.500346 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device e14194d6-6e64-4ab6-8cc7-b801cf1c0174 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:45.508898 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426daf23-f3af-4482-8731-574ad4b2bcbe req-d2ca86ce-0a57-4a1d-b841-54b6ae2e2045 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:45.519209 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-426daf23-f3af-4482-8731-574ad4b2bcbe req-d2ca86ce-0a57-4a1d-b841-54b6ae2e2045 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 945 time: 0.2552793
May 25 16:39:45.519420 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Pushing event updated for resources: {'Port': ['ID=40870ff6-bd4b-41c1-a37d-1ccf6f7c2406,revision_number=3']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:45.524870 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.268s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:45.544279 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:45.630105 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-04890073-2cb2-4610-9db5-557a1c424b30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:45.631570 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-04890073-2cb2-4610-9db5-557a1c424b30 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=73cf5a2c98e64235b56c6c8b43e872f5&device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 1096 time: 0.2324491
May 25 16:39:45.631957 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:45.641009 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:45.654973 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-426daf23-f3af-4482-8731-574ad4b2bcbe req-b64c4c87-2a31-4006-8e6a-419ec6aeb56a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1343644
May 25 16:39:45.676729 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port e14194d6-6e64-4ab6-8cc7-b801cf1c0174 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:45.682098 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port e14194d6-6e64-4ab6-8cc7-b801cf1c0174 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:45.682649 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:45.702572 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78521cca-532f-44f1-9c97-8466b4ad7d0c req-eff51c09-87cf-4abf-9af8-6fab80dd2f73 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:45.704345 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-78521cca-532f-44f1-9c97-8466b4ad7d0c req-eff51c09-87cf-4abf-9af8-6fab80dd2f73 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1468844
May 25 16:39:45.727720 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-debee290-a5bd-4140-9219-3e69c3e27491 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 HTTP/1.1" status: 200  len: 217 time: 0.0838766
May 25 16:39:45.754265 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-d2c8e36b-895c-432d-9d9f-699d7d0f7c4a None None] Provisioning complete for port e14194d6-6e64-4ab6-8cc7-b801cf1c0174 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:45.754636 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d2c8e36b-895c-432d-9d9f-699d7d0f7c4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:45.763113 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-78521cca-532f-44f1-9c97-8466b4ad7d0c req-c4bad2bb-21c9-44ee-a00d-6208a129ca84 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512121
May 25 16:39:45.811960 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-11215276-b0c0-41f4-a3a7-af6596bdf451 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:45.813550 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-11215276-b0c0-41f4-a3a7-af6596bdf451 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=4030a70d-20ce-4ddd-ab1c-d1d794468e8e HTTP/1.1" status: 200  len: 846 time: 0.0774345
May 25 16:39:45.866847 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-ea907622-6ce9-4a4b-ab65-4ede8e877c52 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=5782c094-7ba9-4a97-a5bd-3f5f0a0557b0&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0450168
May 25 16:39:45.867557 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Router fae4d531-8061-45ac-a2da-891f8e090ef1 is scheduled to L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 with binding_index 1 {{(pid=92012) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 16:39:45.889984 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:45.976764 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e65978c1-393d-466e-b9c7-73564389ed64 req-fafbbc8f-54de-4bcf-99d4-ad380ed47fb7 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:45.978922 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d2c8e36b-895c-432d-9d9f-699d7d0f7c4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:45.979143 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e65978c1-393d-466e-b9c7-73564389ed64 req-fafbbc8f-54de-4bcf-99d4-ad380ed47fb7 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0959468
May 25 16:39:45.992583 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port e14194d6-6e64-4ab6-8cc7-b801cf1c0174, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=e14194d6-6e64-4ab6-8cc7-b801cf1c0174,segment=NetworkSegment(80d0c339-d557-4898-a197-cde1821f5d83),segment_id=80d0c339-d557-4898-a197-cde1821f5d83)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:46.000980 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:46.003345 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:46.042014 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e65978c1-393d-466e-b9c7-73564389ed64 req-7ee53c55-c388-4101-a81c-f907daaa6b16 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0563514
May 25 16:39:46.137295 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.db.api [None req-d2c8e36b-895c-432d-9d9f-699d7d0f7c4a None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=92014) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
May 25 16:39:46.137907 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_db.api [None req-d2c8e36b-895c-432d-9d9f-699d7d0f7c4a None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
May 25 16:39:46.138205 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=e14194d6-6e64-4ab6-8cc7-b801cf1c0174,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:46.141634 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:46.325308 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-0079ed49-6c94-4245-befd-032216b790f5 service neutron] 10.222.0.76 "GET /v2.0/networks/5782c094-7ba9-4a97-a5bd-3f5f0a0557b0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4454250
May 25 16:39:46.331943 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:39:46.341652 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Sync routers for ids ['fae4d531-8061-45ac-a2da-891f8e090ef1'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:39:46.347658 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fc9bc22-0ec9-4a01-bf21-c0ef60338c8a req-1b3dc55b-d1d4-4848-8f97-6c430d7f12d2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:46.349177 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2fc9bc22-0ec9-4a01-bf21-c0ef60338c8a req-1b3dc55b-d1d4-4848-8f97-6c430d7f12d2 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 943 time: 0.0895767
May 25 16:39:46.351110 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Routers {'fae4d531-8061-45ac-a2da-891f8e090ef1'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:39:46.351732 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b67f1c0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:39:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['fae4d531-8061-45ac-a2da-891f8e090ef1'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:46.402397 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2fc9bc22-0ec9-4a01-bf21-c0ef60338c8a req-72f4e23c-e86b-4825-bd3c-446fef0dfa43 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466549
May 25 16:39:46.422322 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Notify callbacks [] for router, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:46.423819 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] 10.222.0.73 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 5.7906923
May 25 16:39:46.426909 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 54896) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:46.491857 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-92ad5eb0-3e77-4013-a680-86a5f2ac1bf2 req-2520c9ca-fd55-4179-a298-39d462e84358 service neutron] 10.222.0.76 "GET /v2.0/networks/5782c094-7ba9-4a97-a5bd-3f5f0a0557b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1579807
May 25 16:39:46.541133 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Set router fae4d531-8061-45ac-a2da-891f8e090ef1 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:39:46.619001 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-932ebf49-1135-4355-a81c-2416c043ad84 req-9b2a5596-22c9-4f60-b865-ca87ebac1528 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:46.620559 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-932ebf49-1135-4355-a81c-2416c043ad84 req-9b2a5596-22c9-4f60-b865-ca87ebac1528 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=73cf5a2c98e64235b56c6c8b43e872f5&device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 1096 time: 0.0787222
May 25 16:39:46.788840 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-932ebf49-1135-4355-a81c-2416c043ad84 req-62088e90-645e-47b4-a927-4701c23f2516 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:46.790674 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-932ebf49-1135-4355-a81c-2416c043ad84 req-62088e90-645e-47b4-a927-4701c23f2516 service neutron] 10.222.0.76 "GET /v2.0/networks?id=5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 HTTP/1.1" status: 200  len: 907 time: 0.1637354
May 25 16:39:46.854794 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b67f1c0>, [{'id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'name': 'tempest-TestShelveInstance-1530563751-router', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232'}], 'enable_snat': True}, 'gw_port_id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:40Z', 'updated_at': '2021-05-25T16:39:44Z', 'revision_number': 3, 'project_id': '3aa35a088d0242458aafe4c1b207fec3', 'gw_port': {'id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:33:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 389, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:42Z', 'updated_at': '2021-05-25T16:39:42Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:46.859191 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Checking router: fae4d531-8061-45ac-a2da-891f8e090ef1 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:39:46.859574 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Updating router fae4d531-8061-45ac-a2da-891f8e090ef1 port d7227a1e-9b2e-47b8-9143-9c7dbed387f2 binding host dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:39:46.878592 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-932ebf49-1135-4355-a81c-2416c043ad84 req-45889d51-9efc-4b77-9d46-e807c8edccfd service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 HTTP/1.1" status: 200  len: 217 time: 0.0801651
May 25 16:39:46.915076 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:46.957955 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-932ebf49-1135-4355-a81c-2416c043ad84 req-e4ffd00e-68a2-44ec-a2a5-eed2818e6c38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:46.959542 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-932ebf49-1135-4355-a81c-2416c043ad84 req-e4ffd00e-68a2-44ec-a2a5-eed2818e6c38 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=4030a70d-20ce-4ddd-ab1c-d1d794468e8e HTTP/1.1" status: 200  len: 846 time: 0.0701559
May 25 16:39:47.015641 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:47.020129 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-932ebf49-1135-4355-a81c-2416c043ad84 req-989623e6-c9f9-4171-9d21-37cad3ec6a35 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=5782c094-7ba9-4a97-a5bd-3f5f0a0557b0&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0486348
May 25 16:39:47.093341 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:47.093828 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:47.144439 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ce75d0-f11b-44fb-9f2b-8ab1f40d268f req-7f38a584-dc62-4692-af13-0de93cdd25b1 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:47.152362 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-77ce75d0-f11b-44fb-9f2b-8ab1f40d268f req-7f38a584-dc62-4692-af13-0de93cdd25b1 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 945 time: 0.3354278
May 25 16:39:47.184712 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-932ebf49-1135-4355-a81c-2416c043ad84 req-12d85fa0-88aa-4b94-bbd8-574f503dffc0 service neutron] 10.222.0.76 "GET /v2.0/networks/5782c094-7ba9-4a97-a5bd-3f5f0a0557b0?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1553526
May 25 16:39:47.231425 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device e14194d6-6e64-4ab6-8cc7-b801cf1c0174 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:47.304492 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port e14194d6-6e64-4ab6-8cc7-b801cf1c0174 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:47.305149 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:47.318767 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Notify callbacks [] for port, precommit_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:47.321687 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-77ce75d0-f11b-44fb-9f2b-8ab1f40d268f req-71642b2e-cc82-40a2-9b4f-7fd877ba7d51 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1674778
May 25 16:39:47.337378 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.provisioning_blocks [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Transition to ACTIVE for port object d7227a1e-9b2e-47b8-9143-9c7dbed387f2 will not be triggered until provisioned by entity L2. {{(pid=92015) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:47.339195 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1c23ab-cbd7-47d3-ab7c-abdb27a51a06 req-a6d32a13-d1e0-4f2e-ae10-6daf0b1f40b3 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:47.347065 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9c1c23ab-cbd7-47d3-ab7c-abdb27a51a06 req-a6d32a13-d1e0-4f2e-ae10-6daf0b1f40b3 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.4378688
May 25 16:39:47.360142 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:47.366021 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:47.386006 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-932ebf49-1135-4355-a81c-2416c043ad84 req-4061c517-dc8a-472b-9779-5659829cdcc6 service neutron] 10.222.0.76 "GET /v2.0/networks/5782c094-7ba9-4a97-a5bd-3f5f0a0557b0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1898482
May 25 16:39:47.426046 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9c1c23ab-cbd7-47d3-ab7c-abdb27a51a06 req-691ebbe4-63b9-4b95-afc5-5835ce7c57aa tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0777164
May 25 16:39:47.555618 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-472b7b3f-8912-4021-a3a4-2b9f9226fcc9 None None] Pushing event updated for resources: {'Port': ['ID=d7227a1e-9b2e-47b8-9143-9c7dbed387f2,revision_number=2']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:47.560107 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:47.566515 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-472b7b3f-8912-4021-a3a4-2b9f9226fcc9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:47.571225 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Attempting to bind port d7227a1e-9b2e-47b8-9143-9c7dbed387f2 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:39:47.571987 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Attempting to bind port d7227a1e-9b2e-47b8-9143-9c7dbed387f2 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:39:47.572350 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Attempting to bind port d7227a1e-9b2e-47b8-9143-9c7dbed387f2 on network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:47.578929 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 39, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:39:47.579300 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Checking segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92015) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:39:47.579696 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:47.580082 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Bound using segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:39:47.580548 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Bound port: d7227a1e-9b2e-47b8-9143-9c7dbed387f2, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:39:47.580915 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:47.673109 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] For port d7227a1e-9b2e-47b8-9143-9c7dbed387f2, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92015) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:39:47.677737 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] For port d7227a1e-9b2e-47b8-9143-9c7dbed387f2, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=d7227a1e-9b2e-47b8-9143-9c7dbed387f2,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92015) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:39:47.685508 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:47.692811 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:47.787210 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Routers {'fae4d531-8061-45ac-a2da-891f8e090ef1'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:39:47.787848 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b67f1c0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:39:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['fae4d531-8061-45ac-a2da-891f8e090ef1'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:47.849323 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-472b7b3f-8912-4021-a3a4-2b9f9226fcc9 None None] Pushing event updated for resources: {'Port': ['ID=d7227a1e-9b2e-47b8-9143-9c7dbed387f2,revision_number=3']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:47.863005 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-407485d2-6ceb-4ef5-b928-6a1d52040860 req-ae2f5711-36af-4e13-a3dc-f170be3790c2 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:47.864869 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-407485d2-6ceb-4ef5-b928-6a1d52040860 req-ae2f5711-36af-4e13-a3dc-f170be3790c2 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.3467007
May 25 16:39:47.915559 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-472b7b3f-8912-4021-a3a4-2b9f9226fcc9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:48.030330 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Allocated IP 172.20.0.1 (ca530aa1-a332-4315-a736-76ee81fb8b29/c6bfd6f1-5436-48ae-aff5-b61d9efcb1da/c9b1428b-1669-4a0f-a8a6-102a89f7af1e) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:39:48.041687 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-407485d2-6ceb-4ef5-b928-6a1d52040860 req-45e1ca55-dbdd-4676-9868-f10c651bbb8a tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0904558
May 25 16:39:48.048209 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] Set router fae4d531-8061-45ac-a2da-891f8e090ef1 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:39:48.135351 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad4e2908-1af4-4f5c-9d4a-b650e72c671b req-8346c756-3c4c-4090-abd1-4d23e2daad24 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:48.136794 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ad4e2908-1af4-4f5c-9d4a-b650e72c671b req-8346c756-3c4c-4090-abd1-4d23e2daad24 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 943 time: 0.3224328
May 25 16:39:48.194834 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:39:48.214981 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ad4e2908-1af4-4f5c-9d4a-b650e72c671b req-5a978745-8e67-4458-b21f-04b5f9702de0 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0704162
May 25 16:39:48.248601 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:48.266999 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Transition to ACTIVE for port object c9b1428b-1669-4a0f-a8a6-102a89f7af1e will not be triggered until provisioned by entity DHCP. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:48.296035 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:48.300680 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-3c298ebe-9a3d-4892-b0d3-91b340c61d0e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:48.339761 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=40870ff6-bd4b-41c1-a37d-1ccf6f7c2406,segment=NetworkSegment(73d0d26b-c8b0-4163-b874-267f21730cc2),segment_id=73d0d26b-c8b0-4163-b874-267f21730cc2)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:48.354286 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '40870ff6-bd4b-41c1-a37d-1ccf6f7c2406', 'network_id': '5782c094-7ba9-4a97-a5bd-3f5f0a0557b0', 'port_id': '40870ff6-bd4b-41c1-a37d-1ccf6f7c2406', 'mac_address': 'fa:16:3e:9c:62:27', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 440, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4030a70d-20ce-4ddd-ab1c-d1d794468e8e', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:39:48.360587 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b67f1c0>, [{'id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'name': 'tempest-TestShelveInstance-1530563751-router', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232'}], 'enable_snat': True}, 'gw_port_id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:40Z', 'updated_at': '2021-05-25T16:39:44Z', 'revision_number': 3, 'project_id': '3aa35a088d0242458aafe4c1b207fec3', 'gw_port': {'id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:33:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 389, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:42Z', 'updated_at': '2021-05-25T16:39:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:48.364341 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Network ca530aa1-a332-4315-a736-76ee81fb8b29 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:39:48.365040 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dd64fc7-ade8-4263-b740-b0d44908ba25 None None] The sync data for ids ['fae4d531-8061-45ac-a2da-891f8e090ef1'] in dv-cinder-786386-6-iscsi is: [{'id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'name': 'tempest-TestShelveInstance-1530563751-router', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232'}], 'enable_snat': True}, 'gw_port_id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:40Z', 'updated_at': '2021-05-25T16:39:44Z', 'revision_number': 3, 'project_id': '3aa35a088d0242458aafe4c1b207fec3', 'gw_port': {'id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:33:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 389, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:42Z', 'updated_at': '2021-05-25T16:39:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:39:48.367322 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:48.371082 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:39:48.420669 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:48.428970 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Pushing event updated for resources: {'Port': ['ID=c9b1428b-1669-4a0f-a8a6-102a89f7af1e,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:48.447348 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:39:48.450925 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-501395'] for router_interface, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:48.456044 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:48.482516 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=40870ff6-bd4b-41c1-a37d-1ccf6f7c2406,segment=NetworkSegment(73d0d26b-c8b0-4163-b874-267f21730cc2),segment_id=73d0d26b-c8b0-4163-b874-267f21730cc2)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:48.491179 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:48.494375 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:48.576147 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=40870ff6-bd4b-41c1-a37d-1ccf6f7c2406,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:48.589760 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:48.613281 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:48.696411 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-0c586afe-c298-4ae1-878d-2e27e33fc37e None None] Provisioning for port c9b1428b-1669-4a0f-a8a6-102a89f7af1e completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:48.722598 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-0c586afe-c298-4ae1-878d-2e27e33fc37e None None] Provisioning complete for port c9b1428b-1669-4a0f-a8a6-102a89f7af1e triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:48.722979 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-0c586afe-c298-4ae1-878d-2e27e33fc37e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:48.794035 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-0c586afe-c298-4ae1-878d-2e27e33fc37e None None] Port c9b1428b-1669-4a0f-a8a6-102a89f7af1e cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:39:48.831734 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['40870ff6-bd4b-41c1-a37d-1ccf6f7c2406'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:39:48.887105 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-648bf697-6ef7-4366-9837-b228c89dc286 req-33224b20-7d07-4595-b8b3-8d5d495a311c tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:48.888619 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-648bf697-6ef7-4366-9837-b228c89dc286 req-33224b20-7d07-4595-b8b3-8d5d495a311c tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.2508345
May 25 16:39:48.976910 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-648bf697-6ef7-4366-9837-b228c89dc286 req-fc868444-01ff-4c47-a1a7-4496ce02320c tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0769668
May 25 16:39:49.037695 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:49.044436 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:49.046987 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device d7227a1e-9b2e-47b8-9143-9c7dbed387f2 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:49.081115 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:49.161614 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port d7227a1e-9b2e-47b8-9143-9c7dbed387f2 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:49.181248 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port d7227a1e-9b2e-47b8-9143-9c7dbed387f2 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:49.181682 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:49.224690 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630485', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-501310'] for router_interface, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:49.265044 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Pushing event updated for resources: {'Port': ['ID=c9b1428b-1669-4a0f-a8a6-102a89f7af1e,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:49.328484 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:49.355162 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:49.377302 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port d7227a1e-9b2e-47b8-9143-9c7dbed387f2, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=d7227a1e-9b2e-47b8-9143-9c7dbed387f2,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:49.382843 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:49.386589 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:49.411243 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd3a320-a6da-4e8f-8d62-1d255e185d6c req-249a404a-f76d-4184-adb2-e83e28a9adbf tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:49.412768 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bfd3a320-a6da-4e8f-8d62-1d255e185d6c req-249a404a-f76d-4184-adb2-e83e28a9adbf tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.2414465
May 25 16:39:49.449459 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Network ca530aa1-a332-4315-a736-76ee81fb8b29 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:39:49.452132 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:39:49.495843 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=d7227a1e-9b2e-47b8-9143-9c7dbed387f2,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:49.501354 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:49.556331 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bfd3a320-a6da-4e8f-8d62-1d255e185d6c req-49402bef-17f9-4955-9fa9-931bbd17c7c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1315813
May 25 16:39:49.732208 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-256748df-50cd-4bca-bbf4-026888482f02 None None] Provisioning complete for port c9b1428b-1669-4a0f-a8a6-102a89f7af1e triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:49.732677 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-256748df-50cd-4bca-bbf4-026888482f02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:49.783456 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Router fae4d531-8061-45ac-a2da-891f8e090ef1 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:39:49.822483 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-256748df-50cd-4bca-bbf4-026888482f02 None None] Port c9b1428b-1669-4a0f-a8a6-102a89f7af1e cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:39:50.019110 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e810799-3113-4aa3-8bb2-45f0e6f0ee6e req-bb568c01-6cc2-4073-a7b1-9a37a039e8c4 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:50.020581 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7e810799-3113-4aa3-8bb2-45f0e6f0ee6e req-bb568c01-6cc2-4073-a7b1-9a37a039e8c4 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 944 time: 0.3197227
May 25 16:39:50.193430 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7e810799-3113-4aa3-8bb2-45f0e6f0ee6e req-eea139af-2c7b-4dd1-bfc1-ba154e2a4b0d tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1667564
May 25 16:39:50.199663 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:50.207586 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:39:50.220526 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] 10.222.0.73 "PUT /v2.0/routers/fae4d531-8061-45ac-a2da-891f8e090ef1/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.7924402
May 25 16:39:50.240207 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Sync routers for ids ['fae4d531-8061-45ac-a2da-891f8e090ef1'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:39:50.253534 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba691319-7523-4414-82be-3ed09f80dfc0 req-5925c2b5-7e71-4e0b-ad82-2bec2db1506d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:50.255207 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ba691319-7523-4414-82be-3ed09f80dfc0 req-5925c2b5-7e71-4e0b-ad82-2bec2db1506d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1585989
May 25 16:39:50.275267 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Routers {'fae4d531-8061-45ac-a2da-891f8e090ef1'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:39:50.275904 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346ac04070>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:39:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['fae4d531-8061-45ac-a2da-891f8e090ef1'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:50.309136 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ba691319-7523-4414-82be-3ed09f80dfc0 req-ad739b86-b05f-464f-bc05-e2591a36a129 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0470054
May 25 16:39:50.434310 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:50.452070 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:50.452491 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:50.526538 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Set router fae4d531-8061-45ac-a2da-891f8e090ef1 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:39:50.771092 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e1b85c8-c1b6-4156-b12e-d07659b08c35 req-10fa9615-e821-4598-99e4-6e4bc2182248 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:50.772874 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2e1b85c8-c1b6-4156-b12e-d07659b08c35 req-10fa9615-e821-4598-99e4-6e4bc2182248 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0878017
May 25 16:39:50.791133 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:50.828087 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2e1b85c8-c1b6-4156-b12e-d07659b08c35 req-853e438d-288a-4e35-b7ac-a19314854794 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0475419
May 25 16:39:50.842066 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51c62c09-ee75-47af-aa31-03e6a0bcdb5d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '40870ff6-bd4b-41c1-a37d-1ccf6f7c2406'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:39:50.867622 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=40870ff6-bd4b-41c1-a37d-1ccf6f7c2406,segment=NetworkSegment(73d0d26b-c8b0-4163-b874-267f21730cc2),segment_id=73d0d26b-c8b0-4163-b874-267f21730cc2)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:50.901323 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '51c62c09-ee75-47af-aa31-03e6a0bcdb5d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '40870ff6-bd4b-41c1-a37d-1ccf6f7c2406', 'code': 200}
May 25 16:39:50.905015 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:50.909816 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-13e16089-d1af-47ef-a66b-d8d3aa1a2a11 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:51.010382 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54956) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:51.015297 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=40870ff6-bd4b-41c1-a37d-1ccf6f7c2406,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:51.019792 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:51.020006 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-776775645', 'description': 'tempest-secgroup-smoke-776775645 description', 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:51.030890 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:51.037382 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346ac04070>, [{'id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'name': 'tempest-TestShelveInstance-1530563751-router', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232'}], 'enable_snat': True}, 'gw_port_id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:40Z', 'updated_at': '2021-05-25T16:39:48Z', 'revision_number': 4, 'project_id': '3aa35a088d0242458aafe4c1b207fec3', 'gw_port': {'id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:33:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 389, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:42Z', 'updated_at': '2021-05-25T16:39:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'c9b1428b-1669-4a0f-a8a6-102a89f7af1e', 'name': '', 'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'mac_address': 'fa:16:3e:7d:5f:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'device_owner': 'network:router_interface', 'standard_attr_id': 390, 'fixed_ips': [{'subnet_id': 'c6bfd6f1-5436-48ae-aff5-b61d9efcb1da', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:47Z', 'updated_at': '2021-05-25T16:39:48Z', 'revision_number': 2, 'project_id': '3aa35a088d0242458aafe4c1b207fec3', 'subnets': [{'id': 'c6bfd6f1-5436-48ae-aff5-b61d9efcb1da', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:51.041337 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Usage tracker for resource:security_group and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:51.042744 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device d7227a1e-9b2e-47b8-9143-9c7dbed387f2 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:51.048048 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:51.064878 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:51.076476 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Checking router: fae4d531-8061-45ac-a2da-891f8e090ef1 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:39:51.077034 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Updating router fae4d531-8061-45ac-a2da-891f8e090ef1 port c9b1428b-1669-4a0f-a8a6-102a89f7af1e binding host dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:39:51.080136 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.104586 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:51.109091 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Usage tracker for resource:security_group_rule and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:51.118964 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:51.125383 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:51.153138 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.220221 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port d7227a1e-9b2e-47b8-9143-9c7dbed387f2 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:51.220582 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.271495 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.278096 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.282352 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-81934e9c-c726-4281-ab7d-680710c78b1e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:51.302983 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59c40822-fc6c-4547-bcef-6d76bdd00fae req-4653d885-46a7-455d-9601-91b00e107d74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:51.304643 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-59c40822-fc6c-4547-bcef-6d76bdd00fae req-4653d885-46a7-455d-9601-91b00e107d74 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 1098 time: 0.1529863
May 25 16:39:51.359081 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c290da32-99a9-4156-b987-67e510a15d61,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:51.363382 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:51.375926 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.377223 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.3631794
May 25 16:39:51.380788 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54964) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:51.388154 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-41a040b1-53c8-492d-a639-268c308825b3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Request body: {'security_group_rule': {'security_group_id': 'c290da32-99a9-4156-b987-67e510a15d61', 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:51.394882 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-59c40822-fc6c-4547-bcef-6d76bdd00fae req-909d1797-958f-466d-a7cf-c33ca55308ae service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0796843
May 25 16:39:51.395811 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-41a040b1-53c8-492d-a639-268c308825b3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:51.404622 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-41a040b1-53c8-492d-a639-268c308825b3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Usage tracker for resource:security_group_rule and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:51.409945 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-41a040b1-53c8-492d-a639-268c308825b3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:51.420198 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-41a040b1-53c8-492d-a639-268c308825b3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:51.441022 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-41a040b1-53c8-492d-a639-268c308825b3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.503788 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5295010a-4ad2-4bc6-9255-81475d5fdc5f req-71135d5b-3a70-4c1f-aa9d-d171fc076681 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:51.506193 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5295010a-4ad2-4bc6-9255-81475d5fdc5f req-71135d5b-3a70-4c1f-aa9d-d171fc076681 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 945 time: 0.1796682
May 25 16:39:51.512921 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-41a040b1-53c8-492d-a639-268c308825b3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.518789 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-41a040b1-53c8-492d-a639-268c308825b3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.526994 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-22ad6ad0-87f0-403e-bb3a-aabe35a5c285 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:51.543962 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a040b1-53c8-492d-a639-268c308825b3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9d69b3ae-6abc-4505-9b74-0cf5dcc8652e,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:51.558981 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-41a040b1-53c8-492d-a639-268c308825b3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:51.572464 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-41a040b1-53c8-492d-a639-268c308825b3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.576184 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-41a040b1-53c8-492d-a639-268c308825b3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1918921
May 25 16:39:51.576405 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54968) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:51.578087 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5295010a-4ad2-4bc6-9255-81475d5fdc5f req-5f8bef11-ad1b-4a52-abf1-95fb7bfc5861 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0586798
May 25 16:39:51.584285 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-d2e09753-b0bf-4113-813a-163e19cffc0d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Request body: {'security_group_rule': {'security_group_id': 'c290da32-99a9-4156-b987-67e510a15d61', 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:51.591442 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-d2e09753-b0bf-4113-813a-163e19cffc0d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:51.593386 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab5b711-7c8d-4094-9398-e1c5fe01a281 req-36659980-8363-4ad5-91f4-57712cb66041 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:51.595060 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eab5b711-7c8d-4094-9398-e1c5fe01a281 req-36659980-8363-4ad5-91f4-57712cb66041 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1445858
May 25 16:39:51.605776 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-d2e09753-b0bf-4113-813a-163e19cffc0d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Usage tracker for resource:security_group_rule and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:51.610353 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-d2e09753-b0bf-4113-813a-163e19cffc0d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:51.621643 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-d2e09753-b0bf-4113-813a-163e19cffc0d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:51.658212 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eab5b711-7c8d-4094-9398-e1c5fe01a281 req-e8400e15-3734-4e78-8d51-783593e0d995 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0437386
May 25 16:39:51.658438 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d2e09753-b0bf-4113-813a-163e19cffc0d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.701440 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Notify callbacks [] for port, precommit_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.714393 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Transition to ACTIVE for port object c9b1428b-1669-4a0f-a8a6-102a89f7af1e will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:39:51.721286 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.725675 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:51.730593 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d2e09753-b0bf-4113-813a-163e19cffc0d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.734614 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d2e09753-b0bf-4113-813a-163e19cffc0d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.736605 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-5293a9db-69ea-44b2-8e11-d7d16ecd1b63 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:51.759616 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2e09753-b0bf-4113-813a-163e19cffc0d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=40f4ccb3-278f-45c8-94b1-0695f9dd10b0,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:51.764154 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-d2e09753-b0bf-4113-813a-163e19cffc0d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:51.769757 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d2e09753-b0bf-4113-813a-163e19cffc0d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.771015 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-d2e09753-b0bf-4113-813a-163e19cffc0d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.1937201
May 25 16:39:51.774517 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 54972) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:51.779596 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-b1b6267d-2688-4d21-88f6-df3eef7ef79b tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Request body: {'security_group_rule': {'security_group_id': 'c290da32-99a9-4156-b987-67e510a15d61', 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:51.785493 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-b1b6267d-2688-4d21-88f6-df3eef7ef79b tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:51.788978 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-b1b6267d-2688-4d21-88f6-df3eef7ef79b tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Usage tracker for resource:security_group_rule and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:51.791915 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-b1b6267d-2688-4d21-88f6-df3eef7ef79b tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:51.798688 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-b1b6267d-2688-4d21-88f6-df3eef7ef79b tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:51.818496 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b1b6267d-2688-4d21-88f6-df3eef7ef79b tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.860451 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cae96590-8d26-420b-b5d5-f565cfa1b87b None None] Pushing event updated for resources: {'Port': ['ID=c9b1428b-1669-4a0f-a8a6-102a89f7af1e,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:51.903680 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-cae96590-8d26-420b-b5d5-f565cfa1b87b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:51.909795 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b1b6267d-2688-4d21-88f6-df3eef7ef79b tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.915134 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b1b6267d-2688-4d21-88f6-df3eef7ef79b tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.917237 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:51.946863 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1b6267d-2688-4d21-88f6-df3eef7ef79b tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a3b036de-5e0d-4194-8d3a-d69cf0dc3ab6,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:51.952910 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-b1b6267d-2688-4d21-88f6-df3eef7ef79b tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:51.963550 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b1b6267d-2688-4d21-88f6-df3eef7ef79b tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:51.967357 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-b1b6267d-2688-4d21-88f6-df3eef7ef79b tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1893296
May 25 16:39:51.969171 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 54980) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:51.974554 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-32592bec-cc3b-4fc5-a2a9-a68ddb147ffb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Request body: {'security_group_rule': {'security_group_id': 'c290da32-99a9-4156-b987-67e510a15d61', 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:51.984353 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Attempting to bind port c9b1428b-1669-4a0f-a8a6-102a89f7af1e on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:39:51.985182 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Attempting to bind port c9b1428b-1669-4a0f-a8a6-102a89f7af1e by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '80d0c339-d557-4898-a197-cde1821f5d83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 429, 'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:39:51.994328 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Attempting to bind port c9b1428b-1669-4a0f-a8a6-102a89f7af1e on network ca530aa1-a332-4315-a736-76ee81fb8b29 {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:39:52.002835 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 39, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:39:52.003860 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Checking segment: {'id': '80d0c339-d557-4898-a197-cde1821f5d83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 429, 'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:39:52.007432 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.008406 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Bound using segment: {'id': '80d0c339-d557-4898-a197-cde1821f5d83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 429, 'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:39:52.009108 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Bound port: c9b1428b-1669-4a0f-a8a6-102a89f7af1e, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '80d0c339-d557-4898-a197-cde1821f5d83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 429, 'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:39:52.009824 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.019110 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-32592bec-cc3b-4fc5-a2a9-a68ddb147ffb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:52.034685 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-32592bec-cc3b-4fc5-a2a9-a68ddb147ffb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Usage tracker for resource:security_group_rule and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:52.038439 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-32592bec-cc3b-4fc5-a2a9-a68ddb147ffb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:52.046449 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-32592bec-cc3b-4fc5-a2a9-a68ddb147ffb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:52.091532 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-32592bec-cc3b-4fc5-a2a9-a68ddb147ffb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.111725 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] For port c9b1428b-1669-4a0f-a8a6-102a89f7af1e, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:39:52.117791 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] For port c9b1428b-1669-4a0f-a8a6-102a89f7af1e, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=c9b1428b-1669-4a0f-a8a6-102a89f7af1e,segment=NetworkSegment(80d0c339-d557-4898-a197-cde1821f5d83),segment_id=80d0c339-d557-4898-a197-cde1821f5d83)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:39:52.122481 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97148995-171d-437c-b6e3-14d073ba8ecf req-d9ea7583-fecc-4d78-b6db-262736daf379 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:52.125262 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-97148995-171d-437c-b6e3-14d073ba8ecf req-d9ea7583-fecc-4d78-b6db-262736daf379 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1571932
May 25 16:39:52.126588 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.131557 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:52.208784 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Routers {'fae4d531-8061-45ac-a2da-891f8e090ef1'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:39:52.209774 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346ac04070>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:39:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['fae4d531-8061-45ac-a2da-891f8e090ef1'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:52.211893 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-97148995-171d-437c-b6e3-14d073ba8ecf req-5bca7e46-0f1d-425a-9855-595ec04333ad tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0745811
May 25 16:39:52.213582 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-32592bec-cc3b-4fc5-a2a9-a68ddb147ffb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.220364 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-32592bec-cc3b-4fc5-a2a9-a68ddb147ffb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.222433 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:52.254618 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32592bec-cc3b-4fc5-a2a9-a68ddb147ffb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cb362ffb-6d1f-48a4-aef2-c31aaa86184b,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:52.262804 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-32592bec-cc3b-4fc5-a2a9-a68ddb147ffb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:52.263665 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-32592bec-cc3b-4fc5-a2a9-a68ddb147ffb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.264726 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-32592bec-cc3b-4fc5-a2a9-a68ddb147ffb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.2946935
May 25 16:39:52.267939 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54986) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:52.274044 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Request body: {'security_group_rule': {'security_group_id': 'c290da32-99a9-4156-b987-67e510a15d61', 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:52.281122 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:52.286413 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Usage tracker for resource:security_group_rule and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:52.289452 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:52.295687 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cae96590-8d26-420b-b5d5-f565cfa1b87b None None] Pushing event updated for resources: {'Port': ['ID=c9b1428b-1669-4a0f-a8a6-102a89f7af1e,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:52.300439 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-cae96590-8d26-420b-b5d5-f565cfa1b87b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:52.306505 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:52.317348 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.securitygroups_db [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Project a723bbfba23f463dbb8da0bdacb4b0aa added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 25 16:39:52.323936 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.416554 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] Set router fae4d531-8061-45ac-a2da-891f8e090ef1 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:39:52.486217 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.492425 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.495232 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:52.521429 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e806947c-93a1-420d-b7c5-df22b6c03409,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:52.524272 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:52.531407 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.532647 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.2635493
May 25 16:39:52.535482 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 54990) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:39:52.541066 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Request body: {'security_group_rule': {'security_group_id': 'c290da32-99a9-4156-b987-67e510a15d61', 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:39:52.549118 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:39:52.553033 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Usage tracker for resource:security_group_rule and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:39:52.556940 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:39:52.562913 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:39:52.573890 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.securitygroups_db [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Project a723bbfba23f463dbb8da0bdacb4b0aa added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 25 16:39:52.579982 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.656765 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.663746 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.672706 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:52.694559 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=556fdf66-08b1-4904-b490-a5dc74665623,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:52.702606 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:52.721019 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:52.731024 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.1941729
May 25 16:39:52.771156 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346ac04070>, [{'id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'name': 'tempest-TestShelveInstance-1530563751-router', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232'}], 'enable_snat': True}, 'gw_port_id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:40Z', 'updated_at': '2021-05-25T16:39:48Z', 'revision_number': 4, 'project_id': '3aa35a088d0242458aafe4c1b207fec3', 'gw_port': {'id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:33:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 389, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:42Z', 'updated_at': '2021-05-25T16:39:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'c9b1428b-1669-4a0f-a8a6-102a89f7af1e', 'name': '', 'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'mac_address': 'fa:16:3e:7d:5f:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'device_owner': 'network:router_interface', 'standard_attr_id': 390, 'fixed_ips': [{'subnet_id': 'c6bfd6f1-5436-48ae-aff5-b61d9efcb1da', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:47Z', 'updated_at': '2021-05-25T16:39:52Z', 'revision_number': 4, 'project_id': '3aa35a088d0242458aafe4c1b207fec3', 'subnets': [{'id': 'c6bfd6f1-5436-48ae-aff5-b61d9efcb1da', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:39:52.776055 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91f1d58b-dfad-40a6-b5a8-cb9d61a97eda None None] The sync data for ids ['fae4d531-8061-45ac-a2da-891f8e090ef1'] in dv-cinder-786386-6-iscsi is: [{'id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'name': 'tempest-TestShelveInstance-1530563751-router', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232'}], 'enable_snat': True}, 'gw_port_id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:40Z', 'updated_at': '2021-05-25T16:39:48Z', 'revision_number': 4, 'project_id': '3aa35a088d0242458aafe4c1b207fec3', 'gw_port': {'id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:33:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 389, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:42Z', 'updated_at': '2021-05-25T16:39:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'c9b1428b-1669-4a0f-a8a6-102a89f7af1e', 'name': '', 'network_id': 'ca530aa1-a332-4315-a736-76ee81fb8b29', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'mac_address': 'fa:16:3e:7d:5f:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'device_owner': 'network:router_interface', 'standard_attr_id': 390, 'fixed_ips': [{'subnet_id': 'c6bfd6f1-5436-48ae-aff5-b61d9efcb1da', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:47Z', 'updated_at': '2021-05-25T16:39:52Z', 'revision_number': 4, 'project_id': '3aa35a088d0242458aafe4c1b207fec3', 'subnets': [{'id': 'c6bfd6f1-5436-48ae-aff5-b61d9efcb1da', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:39:52.960159 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc38ac8-4f9a-44d2-8a60-87248ef30749 req-ae501046-a4dc-4ba7-8ad1-f5fde59073f7 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:52.961678 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1dc38ac8-4f9a-44d2-8a60-87248ef30749 req-ae501046-a4dc-4ba7-8ad1-f5fde59073f7 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 945 time: 0.2128241
May 25 16:39:53.031797 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46bc0398-5054-4b7e-b045-617fccfa3415 req-3c6fa665-836f-4d2d-867d-d329df66f3b0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:53.041857 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-46bc0398-5054-4b7e-b045-617fccfa3415 req-3c6fa665-836f-4d2d-867d-d329df66f3b0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1671920
May 25 16:39:53.046860 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1dc38ac8-4f9a-44d2-8a60-87248ef30749 req-48101aa3-25cc-4c5e-affc-654ab30aa0ce tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0747960
May 25 16:39:53.053160 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device c9b1428b-1669-4a0f-a8a6-102a89f7af1e up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:53.119972 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-46bc0398-5054-4b7e-b045-617fccfa3415 req-36e5f78a-7bb6-4483-bc50-9d189441f436 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0770907
May 25 16:39:53.184325 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port c9b1428b-1669-4a0f-a8a6-102a89f7af1e completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:39:53.198442 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port c9b1428b-1669-4a0f-a8a6-102a89f7af1e triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:53.198788 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:53.344194 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:53.389067 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port c9b1428b-1669-4a0f-a8a6-102a89f7af1e, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=c9b1428b-1669-4a0f-a8a6-102a89f7af1e,segment=NetworkSegment(80d0c339-d557-4898-a197-cde1821f5d83),segment_id=80d0c339-d557-4898-a197-cde1821f5d83)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:53.397858 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:53.399494 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-a08e0089-1502-441f-956b-aa0553a8002b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:53.450241 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b5a943a-87dc-4f91-b40f-6916ef3c01b8 req-458c3ccf-ecd7-4a4a-a7ec-8927b543e86e tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:53.455879 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1b5a943a-87dc-4f91-b40f-6916ef3c01b8 req-458c3ccf-ecd7-4a4a-a7ec-8927b543e86e tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1016700
May 25 16:39:53.473500 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=c9b1428b-1669-4a0f-a8a6-102a89f7af1e,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:53.477481 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:53.502635 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1b5a943a-87dc-4f91-b40f-6916ef3c01b8 req-d2f78ff4-3c19-424d-be4a-84597d256852 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0432305
May 25 16:39:54.348029 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed3eed98-103d-409b-bb4b-6340ebdcbe14 req-34e17174-2ec0-407f-850b-f29724778984 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:54.349556 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ed3eed98-103d-409b-bb4b-6340ebdcbe14 req-34e17174-2ec0-407f-850b-f29724778984 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 945 time: 0.1593726
May 25 16:39:54.359646 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81fa3414-6d6a-4900-b486-39a97abef65d req-91d28dac-ee50-4ffd-ad71-9b9e1070783b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:54.361174 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-81fa3414-6d6a-4900-b486-39a97abef65d req-91d28dac-ee50-4ffd-ad71-9b9e1070783b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1384256
May 25 16:39:54.430845 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ed3eed98-103d-409b-bb4b-6340ebdcbe14 req-526c0492-193b-43bf-8ca1-e2bf5d4d755e tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0686212
May 25 16:39:54.443453 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-81fa3414-6d6a-4900-b486-39a97abef65d req-34721b86-4f4a-4cc5-a766-a2da597474cb tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0659399
May 25 16:39:54.718748 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62a1f21a-f4fc-466f-9010-cb957f77c6d3 req-83531640-7af3-4457-bc71-602f2ab6b101 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:54.720197 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-62a1f21a-f4fc-466f-9010-cb957f77c6d3 req-83531640-7af3-4457-bc71-602f2ab6b101 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0906279
May 25 16:39:54.772884 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-62a1f21a-f4fc-466f-9010-cb957f77c6d3 req-ad99ae92-79f5-4d5a-be05-6706c4e1d66c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0437434
May 25 16:39:54.992315 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device c9b1428b-1669-4a0f-a8a6-102a89f7af1e up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:39:55.087024 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port c9b1428b-1669-4a0f-a8a6-102a89f7af1e triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:39:55.087390 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:55.664361 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd88ca1c-a816-4146-84d5-5d245b0e2905 req-c648f569-13d4-451d-bbfa-052e26fda447 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:55.666248 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cd88ca1c-a816-4146-84d5-5d245b0e2905 req-c648f569-13d4-451d-bbfa-052e26fda447 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0946612
May 25 16:39:55.719362 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cd88ca1c-a816-4146-84d5-5d245b0e2905 req-7c857368-ca7e-417d-a67c-aedf6aebeaaa tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0468554
May 25 16:39:55.942442 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae8ad04b-8c3f-4d7d-a7ff-c8e5710cd864 req-cc5283e4-eaca-442e-a524-4159c356fe41 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:55.944065 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ae8ad04b-8c3f-4d7d-a7ff-c8e5710cd864 req-cc5283e4-eaca-442e-a524-4159c356fe41 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 945 time: 0.1285958
May 25 16:39:56.087920 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ae8ad04b-8c3f-4d7d-a7ff-c8e5710cd864 req-5df108f9-2396-4dc2-b16a-a1f8bad88e71 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1359150
May 25 16:39:56.102508 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08dab310-3e37-4a52-9c28-0b7e6325e1b7 req-d8a2c1d4-60d2-4057-ab51-7037fbad263e tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:56.103944 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-08dab310-3e37-4a52-9c28-0b7e6325e1b7 req-d8a2c1d4-60d2-4057-ab51-7037fbad263e tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.2131658
May 25 16:39:56.148359 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-08dab310-3e37-4a52-9c28-0b7e6325e1b7 req-d029ce3e-11a0-4cfd-a91b-9e9aba066cba tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0386555
May 25 16:39:56.498118 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22a6ffbe-ee3f-4bb6-8743-0aa087b59e39 req-b38b0abe-9ab8-40fc-bc00-3e0ee5903242 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:56.499586 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-22a6ffbe-ee3f-4bb6-8743-0aa087b59e39 req-b38b0abe-9ab8-40fc-bc00-3e0ee5903242 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0878196
May 25 16:39:56.550600 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-22a6ffbe-ee3f-4bb6-8743-0aa087b59e39 req-374fdfbd-67aa-421f-a649-042ebf37856c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0448248
May 25 16:39:56.574252 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96099b31-0f2c-47c7-8d98-fe3fcb7f401a req-357716d4-3041-4fa2-b76b-6f1e56dedfb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:56.575725 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-96099b31-0f2c-47c7-8d98-fe3fcb7f401a req-357716d4-3041-4fa2-b76b-6f1e56dedfb8 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=63f896ab0d7e44158204551033c33ba4&device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 1098 time: 0.0907135
May 25 16:39:56.713697 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96099b31-0f2c-47c7-8d98-fe3fcb7f401a req-328d49a0-3de9-4677-a542-652951254926 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:56.715111 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-96099b31-0f2c-47c7-8d98-fe3fcb7f401a req-328d49a0-3de9-4677-a542-652951254926 service neutron] 10.222.0.76 "GET /v2.0/networks?id=ce683266-622a-4b13-a610-301441bf2882 HTTP/1.1" status: 200  len: 912 time: 0.1271770
May 25 16:39:56.838201 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-96099b31-0f2c-47c7-8d98-fe3fcb7f401a req-3d8aaaec-2e1c-4145-af69-a9310a48983c service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2b1a8c74-03d6-4f98-a405-94fc04b50dd4 HTTP/1.1" status: 200  len: 1001 time: 0.1128016
May 25 16:39:56.926196 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96099b31-0f2c-47c7-8d98-fe3fcb7f401a req-9a33633b-94a6-4efb-b842-ac785beba094 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:56.928745 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-96099b31-0f2c-47c7-8d98-fe3fcb7f401a req-9a33633b-94a6-4efb-b842-ac785beba094 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=06161ba6-62a3-443f-9cfb-bccf3f60ad9c HTTP/1.1" status: 200  len: 850 time: 0.0700345
May 25 16:39:56.928953 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c2d5c35-98d3-4b5a-a62a-668473b63258 req-130672eb-10a9-422c-b5fc-1c1461c426f0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:56.930727 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4c2d5c35-98d3-4b5a-a62a-668473b63258 req-130672eb-10a9-422c-b5fc-1c1461c426f0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0943501
May 25 16:39:56.991719 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4c2d5c35-98d3-4b5a-a62a-668473b63258 req-2989cfe4-6bc0-492d-8306-f83238c9e534 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0532928
May 25 16:39:57.026243 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96099b31-0f2c-47c7-8d98-fe3fcb7f401a req-b697ff06-ff40-419b-abc1-69df2efde36c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:57.028406 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-96099b31-0f2c-47c7-8d98-fe3fcb7f401a req-b697ff06-ff40-419b-abc1-69df2efde36c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ce683266-622a-4b13-a610-301441bf2882&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0842686
May 25 16:39:57.173589 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-96099b31-0f2c-47c7-8d98-fe3fcb7f401a req-2e616089-6dba-4cf0-8646-9934b79df40d service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1366513
May 25 16:39:57.286075 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-394a80fe-7acc-4cf2-bc86-8ab09265fe4e req-95bc3479-7238-4d24-8a5d-f233be189c84 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:57.287555 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-394a80fe-7acc-4cf2-bc86-8ab09265fe4e req-95bc3479-7238-4d24-8a5d-f233be189c84 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 945 time: 0.0872972
May 25 16:39:57.332368 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-96099b31-0f2c-47c7-8d98-fe3fcb7f401a req-3eb9ca6e-1aef-4a1c-9d21-7ea2bfb7e7bf service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1368749
May 25 16:39:57.336828 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-394a80fe-7acc-4cf2-bc86-8ab09265fe4e req-9e09d780-a656-404d-8e24-f3bb6fba761e tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433459
May 25 16:39:57.748886 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bca6d7b-dce6-410f-a0e1-974725bf27c9 req-f6f37824-900b-434a-9432-4c537801f88f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:57.750377 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7bca6d7b-dce6-410f-a0e1-974725bf27c9 req-f6f37824-900b-434a-9432-4c537801f88f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0918541
May 25 16:39:57.799617 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7bca6d7b-dce6-410f-a0e1-974725bf27c9 req-0b111bee-3623-405c-b738-9d3153f897bd tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0432689
May 25 16:39:58.062828 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-067bf814-ea50-41db-8154-56d4c48eb5f4 req-a14e1f51-cf12-4a63-b934-788b65523ace tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:58.064141 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-067bf814-ea50-41db-8154-56d4c48eb5f4 req-a14e1f51-cf12-4a63-b934-788b65523ace tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Synchronizing usage tracker for tenant:73cf5a2c98e64235b56c6c8b43e872f5 on resource:port {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:39:58.086098 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-067bf814-ea50-41db-8154-56d4c48eb5f4 req-a14e1f51-cf12-4a63-b934-788b65523ace tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Unset dirty status for tenant:73cf5a2c98e64235b56c6c8b43e872f5 on resource:port {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:39:58.087255 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-067bf814-ea50-41db-8154-56d4c48eb5f4 req-a14e1f51-cf12-4a63-b934-788b65523ace tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.76 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 945 time: 0.1088760
May 25 16:39:58.270309 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-067bf814-ea50-41db-8154-56d4c48eb5f4 req-0be85798-623f-44e3-8bdb-96b08f5d6869 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Deleting port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:39:58.270664 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-067bf814-ea50-41db-8154-56d4c48eb5f4 req-0be85798-623f-44e3-8bdb-96b08f5d6869 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:58.359635 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f626a6cc-eaa1-40a4-9fba-a7309ea472d7 req-ba5953fa-701b-4d73-ab3d-42f68a5807cc tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:58.375209 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f626a6cc-eaa1-40a4-9fba-a7309ea472d7 req-ba5953fa-701b-4d73-ab3d-42f68a5807cc tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1331465
May 25 16:39:58.438265 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f626a6cc-eaa1-40a4-9fba-a7309ea472d7 req-e6ab4ed7-96d6-40ef-bb43-8e12f957f5c5 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0533042
May 25 16:39:58.442970 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-067bf814-ea50-41db-8154-56d4c48eb5f4 req-0be85798-623f-44e3-8bdb-96b08f5d6869 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] For port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=40870ff6-bd4b-41c1-a37d-1ccf6f7c2406,segment=NetworkSegment(73d0d26b-c8b0-4163-b874-267f21730cc2),segment_id=73d0d26b-c8b0-4163-b874-267f21730cc2)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:39:58.449712 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-067bf814-ea50-41db-8154-56d4c48eb5f4 req-0be85798-623f-44e3-8bdb-96b08f5d6869 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:58.550377 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d911ef-96e0-4f64-a2b2-4decca6ce723 req-1efe2a1c-4bd3-4d6d-a910-96c41c006617 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:58.551847 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f3d911ef-96e0-4f64-a2b2-4decca6ce723 req-1efe2a1c-4bd3-4d6d-a910-96c41c006617 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 945 time: 0.0837028
May 25 16:39:58.576434 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-067bf814-ea50-41db-8154-56d4c48eb5f4 req-0be85798-623f-44e3-8bdb-96b08f5d6869 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Calling delete_port for 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 owned by compute:nova {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:39:58.602332 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f3d911ef-96e0-4f64-a2b2-4decca6ce723 req-18991ef8-cea9-42ec-830c-7bdfdc324f9b tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/security-groups?id=37f99fe6-9311-4629-b99b-d75270870d12&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436296
May 25 16:39:58.699008 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-067bf814-ea50-41db-8154-56d4c48eb5f4 req-0be85798-623f-44e3-8bdb-96b08f5d6869 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:58.704525 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a9bd52c0-d0c6-4ce8-902d-a97876f730a0 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:39:58.751772 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be85798-623f-44e3-8bdb-96b08f5d6869 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Pushing event deleted for resources: {'Port': ['ID=40870ff6-bd4b-41c1-a37d-1ccf6f7c2406,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:39:58.755024 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0be85798-623f-44e3-8bdb-96b08f5d6869 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:39:58.918090 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [req-067bf814-ea50-41db-8154-56d4c48eb5f4 req-0be85798-623f-44e3-8bdb-96b08f5d6869 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] No DVR routers for this DVR port 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 on host hv-cinder-78638 {{(pid=92012) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:39:58.921083 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-067bf814-ea50-41db-8154-56d4c48eb5f4 req-0be85798-623f-44e3-8bdb-96b08f5d6869 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:39:58.923842 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51c62c09-ee75-47af-aa31-03e6a0bcdb5d', 'name': 'network-vif-deleted', 'tag': '40870ff6-bd4b-41c1-a37d-1ccf6f7c2406'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:39:58.943057 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-067bf814-ea50-41db-8154-56d4c48eb5f4 req-0be85798-623f-44e3-8bdb-96b08f5d6869 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.76 "DELETE /v2.0/ports/40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 HTTP/1.1" status: 204  len: 173 time: 0.8448884
May 25 16:39:58.977481 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '51c62c09-ee75-47af-aa31-03e6a0bcdb5d', 'name': 'network-vif-deleted', 'tag': '40870ff6-bd4b-41c1-a37d-1ccf6f7c2406', 'status': 'completed', 'code': 200}
May 25 16:39:59.010971 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60fb8d7a-7d18-4948-aca4-604710b61da2 req-f1be3ec8-bff1-402f-acb5-b451137b2e07 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:59.012514 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-60fb8d7a-7d18-4948-aca4-604710b61da2 req-f1be3ec8-bff1-402f-acb5-b451137b2e07 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0940855
May 25 16:39:59.061661 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-60fb8d7a-7d18-4948-aca4-604710b61da2 req-495868f7-f187-456e-8213-34f7f4071c70 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421858
May 25 16:39:59.630786 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4b7bdb9-5dda-4d96-930d-6b3812f13ff5 req-934554c4-6191-4f4b-8acf-a9bc6e3d3c98 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:39:59.633313 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b4b7bdb9-5dda-4d96-930d-6b3812f13ff5 req-934554c4-6191-4f4b-8acf-a9bc6e3d3c98 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0879660
May 25 16:39:59.686732 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b4b7bdb9-5dda-4d96-930d-6b3812f13ff5 req-60952ff3-307e-467c-bac5-b923c5a7c696 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0464356
May 25 16:39:59.797969 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-48402de0-a0f9-43f0-b20b-2bcc1e18d380 req-7ead501f-06b0-4ee7-9f30-1dba17956c33 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] 10.222.0.73 "GET /v2.0/ports?device_id=51c62c09-ee75-47af-aa31-03e6a0bcdb5d HTTP/1.1" status: 200  len: 210 time: 0.0457380
May 25 16:40:00.260594 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:40:00.327312 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:40:00.327554 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 40870ff6-bd4b-41c1-a37d-1ccf6f7c2406 not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:40:00.888356 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd8313e9-507a-4c03-809d-53e0d7d17122 req-326e29c6-7138-44b4-a944-4fa6e84e63f0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:00.889857 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cd8313e9-507a-4c03-809d-53e0d7d17122 req-326e29c6-7138-44b4-a944-4fa6e84e63f0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0935986
May 25 16:40:00.950317 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cd8313e9-507a-4c03-809d-53e0d7d17122 req-5676fb27-3e39-4f56-9e54-3b6f45bd3366 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0483077
May 25 16:40:01.401792 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-5f2fb2b5-f8b5-4ac5-a8d6-771570ef9622 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:02.143591 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a9050a-3415-4ee8-8d28-007c1a824377 req-1d0643bb-0546-4482-a9b3-f52391980474 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:02.145035 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-53a9050a-3415-4ee8-8d28-007c1a824377 req-1d0643bb-0546-4482-a9b3-f52391980474 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 945 time: 0.1353557
May 25 16:40:02.206361 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-53a9050a-3415-4ee8-8d28-007c1a824377 req-3e9a2287-1746-4114-b5e7-bc34b3047321 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0539517
May 25 16:40:02.214542 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a9d90d-6510-4471-a328-1ef0fae492d0 req-ffa9bbeb-f29a-4913-8909-cfa5d216ecb5 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:02.215964 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-82a9d90d-6510-4471-a328-1ef0fae492d0 req-ffa9bbeb-f29a-4913-8909-cfa5d216ecb5 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1397285
May 25 16:40:02.266544 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-82a9d90d-6510-4471-a328-1ef0fae492d0 req-793c7102-292b-4b15-9e4a-4cd74e89058b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430877
May 25 16:40:03.403926 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-729751dc-12a6-4083-95b9-1cb4673afb25 req-f49a5684-a15f-4935-ba5a-9d81653ede39 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:03.405380 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-729751dc-12a6-4083-95b9-1cb4673afb25 req-f49a5684-a15f-4935-ba5a-9d81653ede39 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 945 time: 0.0786092
May 25 16:40:03.454203 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-729751dc-12a6-4083-95b9-1cb4673afb25 req-509424fd-a31c-404c-9047-1035ffe5c91d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430231
May 25 16:40:03.642891 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76e0248c-9328-4583-ae51-360ffd90fb9f req-3735edc8-34ab-4660-9497-eb6cd483d361 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:03.644708 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-76e0248c-9328-4583-ae51-360ffd90fb9f req-3735edc8-34ab-4660-9497-eb6cd483d361 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0817981
May 25 16:40:03.700126 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-76e0248c-9328-4583-ae51-360ffd90fb9f req-2c8363aa-cab8-43ac-97c0-492d0b388b73 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0491745
May 25 16:40:03.838428 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:04.112478 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4f42d474-1245-4714-be87-c64ec4b7ca47 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:04.650615 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-127e62a7-dc73-4217-87d9-d1418e8a58f4 req-9d65577b-ee06-488c-8cc9-80bb7447e30b tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:04.652130 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-127e62a7-dc73-4217-87d9-d1418e8a58f4 req-9d65577b-ee06-488c-8cc9-80bb7447e30b tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 945 time: 0.0871985
May 25 16:40:04.698141 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-127e62a7-dc73-4217-87d9-d1418e8a58f4 req-6d848a08-5770-40fc-b5a9-e92f8cc81f54 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400171
May 25 16:40:04.895961 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a1fbd67-4639-4ea5-9ce6-4bdec2fc2ca1 req-985e5f04-677e-4804-b7a1-8b1fafea900b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:04.898006 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3a1fbd67-4639-4ea5-9ce6-4bdec2fc2ca1 req-985e5f04-677e-4804-b7a1-8b1fafea900b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0865638
May 25 16:40:04.943977 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3a1fbd67-4639-4ea5-9ce6-4bdec2fc2ca1 req-03c816ce-1168-4aed-8a03-45d451b7369e tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403962
May 25 16:40:05.039135 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:05.907299 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be5f421-0fbc-4c47-a47b-ed9f127479d5 req-6e8319dc-0732-4e2e-af65-634c565be4f0 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:05.908727 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5be5f421-0fbc-4c47-a47b-ed9f127479d5 req-6e8319dc-0732-4e2e-af65-634c565be4f0 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 945 time: 0.0964384
May 25 16:40:05.957511 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5be5f421-0fbc-4c47-a47b-ed9f127479d5 req-728bfb35-8d8a-43f5-9af3-b3bfe122cd9c tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425920
May 25 16:40:06.144570 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d03a2ef-afcc-4bbd-b0d1-e706a9ee4d06 req-7732861b-d336-43a3-8712-f484501a984a tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:06.146146 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8d03a2ef-afcc-4bbd-b0d1-e706a9ee4d06 req-7732861b-d336-43a3-8712-f484501a984a tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0841711
May 25 16:40:06.197159 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8d03a2ef-afcc-4bbd-b0d1-e706a9ee4d06 req-db01fb63-c0b7-4700-a586-a71af912554f tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0450623
May 25 16:40:06.552925 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:07.073756 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f459c49b-be1a-46aa-9b2e-86d040535f31 req-0042a999-ac2f-43bd-adee-b5bf25d9c68e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:07.074646 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-f459c49b-be1a-46aa-9b2e-86d040535f31 req-0042a999-ac2f-43bd-adee-b5bf25d9c68e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Synchronizing usage tracker for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:40:07.090880 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-f459c49b-be1a-46aa-9b2e-86d040535f31 req-0042a999-ac2f-43bd-adee-b5bf25d9c68e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Unset dirty status for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:40:07.092643 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-f459c49b-be1a-46aa-9b2e-86d040535f31 req-0042a999-ac2f-43bd-adee-b5bf25d9c68e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 945 time: 0.1171217
May 25 16:40:07.278295 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46933c6d-9341-4bea-9ff1-f7e7a9481dfc req-e254d111-b586-4434-85fb-55e4ac0abbd3 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:07.279414 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-46933c6d-9341-4bea-9ff1-f7e7a9481dfc req-e254d111-b586-4434-85fb-55e4ac0abbd3 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 945 time: 0.1954596
May 25 16:40:07.286064 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-f459c49b-be1a-46aa-9b2e-86d040535f31 req-7db6d709-edf7-4c3a-9bd7-036a8b5fc5bc tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Deleting port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:40:07.286419 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-f459c49b-be1a-46aa-9b2e-86d040535f31 req-7db6d709-edf7-4c3a-9bd7-036a8b5fc5bc tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:07.398315 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-46933c6d-9341-4bea-9ff1-f7e7a9481dfc req-3840fccd-bce5-49ce-a3d1-fef0330ef8ed tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1131625
May 25 16:40:07.451416 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c106968-c8fd-462b-b395-a7a82a3a544a req-ac10baff-ede5-48fb-b575-a5b9838d925e tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:07.473784 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-f459c49b-be1a-46aa-9b2e-86d040535f31 req-7db6d709-edf7-4c3a-9bd7-036a8b5fc5bc tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] For port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=124d05f4-1b92-4b0c-8e3b-05ecdf7db82e,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:07.474408 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-f459c49b-be1a-46aa-9b2e-86d040535f31 req-7db6d709-edf7-4c3a-9bd7-036a8b5fc5bc tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:07.488780 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0c106968-c8fd-462b-b395-a7a82a3a544a req-ac10baff-ede5-48fb-b575-a5b9838d925e tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1495161
May 25 16:40:07.538921 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0c106968-c8fd-462b-b395-a7a82a3a544a req-c5bc0cc7-33ab-4f57-b7ca-836bfc398fcf tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466418
May 25 16:40:07.609266 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-f459c49b-be1a-46aa-9b2e-86d040535f31 req-7db6d709-edf7-4c3a-9bd7-036a8b5fc5bc tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Calling delete_port for 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e owned by compute:nova {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:40:07.741882 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-f459c49b-be1a-46aa-9b2e-86d040535f31 req-7db6d709-edf7-4c3a-9bd7-036a8b5fc5bc tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:07.748586 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:07.755565 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['39034fee-da76-49d9-a359-2be89ce60575', 'dc96a24c-e6ea-4174-9a11-ac0ae925b8fb', '7b0a5381-d69e-445c-9ee0-f4004f815424', '124d05f4-1b92-4b0c-8e3b-05ecdf7db82e'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:40:07.799870 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7db6d709-edf7-4c3a-9bd7-036a8b5fc5bc tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Pushing event deleted for resources: {'Port': ['ID=124d05f4-1b92-4b0c-8e3b-05ecdf7db82e,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:07.802885 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7db6d709-edf7-4c3a-9bd7-036a8b5fc5bc tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:07.885223 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [req-f459c49b-be1a-46aa-9b2e-86d040535f31 req-7db6d709-edf7-4c3a-9bd7-036a8b5fc5bc tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] No DVR routers for this DVR port 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e on host hv-cinder-78638 {{(pid=92012) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:40:07.888028 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-f459c49b-be1a-46aa-9b2e-86d040535f31 req-7db6d709-edf7-4c3a-9bd7-036a8b5fc5bc tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:07.899081 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '207381c7-af2d-4515-9ed9-8e1fb121ef03', 'name': 'network-vif-deleted', 'tag': '124d05f4-1b92-4b0c-8e3b-05ecdf7db82e'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:40:07.916330 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-f459c49b-be1a-46aa-9b2e-86d040535f31 req-7db6d709-edf7-4c3a-9bd7-036a8b5fc5bc tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "DELETE /v2.0/ports/124d05f4-1b92-4b0c-8e3b-05ecdf7db82e HTTP/1.1" status: 204  len: 173 time: 0.8174672
May 25 16:40:07.974347 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '207381c7-af2d-4515-9ed9-8e1fb121ef03', 'name': 'network-vif-deleted', 'tag': '124d05f4-1b92-4b0c-8e3b-05ecdf7db82e', 'status': 'completed', 'code': 200}
May 25 16:40:08.667554 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fa66c267-c754-4daf-8d22-9e848826ba08 req-55663c2d-64e0-4464-86df-bddab3709111 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=207381c7-af2d-4515-9ed9-8e1fb121ef03 HTTP/1.1" status: 200  len: 210 time: 0.0810115
May 25 16:40:08.802317 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-662c0a50-c30c-4b00-ab1e-afc928095b2b req-2c5f52dc-956e-4376-af3a-03a661ed43cc tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:08.805717 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-662c0a50-c30c-4b00-ab1e-afc928095b2b req-2c5f52dc-956e-4376-af3a-03a661ed43cc tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1253080
May 25 16:40:08.858423 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-662c0a50-c30c-4b00-ab1e-afc928095b2b req-7bda6a4f-4a1a-4e36-aee4-a3e9fdda87ae tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0467591
May 25 16:40:10.065656 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d4901f-3c4b-4af2-aeb4-0096684d9d5a req-dfd09686-09b8-4a6c-8170-515d01b1821e tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:10.068501 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e5d4901f-3c4b-4af2-aeb4-0096684d9d5a req-dfd09686-09b8-4a6c-8170-515d01b1821e tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0929120
May 25 16:40:10.113709 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e5d4901f-3c4b-4af2-aeb4-0096684d9d5a req-a8f16a8e-a075-468d-a0f8-86203561d211 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388927
May 25 16:40:10.325191 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:40:10.364031 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:40:10.364329 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 124d05f4-1b92-4b0c-8e3b-05ecdf7db82e not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:40:11.498432 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19792e09-3eda-4bb0-b985-b7242b63a487 req-3fdb61e4-6756-402c-bda4-00c89c7c15ab tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:11.499923 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-19792e09-3eda-4bb0-b985-b7242b63a487 req-3fdb61e4-6756-402c-bda4-00c89c7c15ab tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.2344606
May 25 16:40:11.540529 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce11aa38-4ea7-40b5-8a17-2683da0f6e0b req-aab958f6-02e9-4511-b700-0123ef725e0f tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:11.542086 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ce11aa38-4ea7-40b5-8a17-2683da0f6e0b req-aab958f6-02e9-4511-b700-0123ef725e0f tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 945 time: 0.1429329
May 25 16:40:11.581590 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-19792e09-3eda-4bb0-b985-b7242b63a487 req-367f7511-4391-4c36-a227-3915d0f3b5f3 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0757542
May 25 16:40:11.617256 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ce11aa38-4ea7-40b5-8a17-2683da0f6e0b req-591bd760-c4ce-4228-8f7c-94d9ef429450 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0671294
May 25 16:40:12.423064 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1502446-dee2-41a7-8ce8-b209182bb0c9 req-39692cce-0531-4403-9212-6832d3589140 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:12.424573 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e1502446-dee2-41a7-8ce8-b209182bb0c9 req-39692cce-0531-4403-9212-6832d3589140 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 1099 time: 0.0776587
May 25 16:40:12.472439 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e1502446-dee2-41a7-8ce8-b209182bb0c9 req-bde3aee4-6453-44ea-8c1e-8b6b7fbf85bc service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404072
May 25 16:40:12.870090 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b482219-7ce8-49f5-aa42-a25661941262 req-81f45361-0211-4770-8630-ff4b207dd702 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:12.871535 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b482219-7ce8-49f5-aa42-a25661941262 req-81f45361-0211-4770-8630-ff4b207dd702 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 945 time: 0.1136768
May 25 16:40:12.878901 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f5057a5-c7f6-4538-b3f9-ccf43b7ebf53 req-d63c5fa3-b3f7-46b2-a4a7-13e14794abe3 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:12.880258 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8f5057a5-c7f6-4538-b3f9-ccf43b7ebf53 req-d63c5fa3-b3f7-46b2-a4a7-13e14794abe3 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1625252
May 25 16:40:12.960406 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b482219-7ce8-49f5-aa42-a25661941262 req-91b68745-7b49-4b38-a1f6-d3da54d42ff5 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0790951
May 25 16:40:12.975161 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8f5057a5-c7f6-4538-b3f9-ccf43b7ebf53 req-1f1ac452-c6e0-413f-9267-f98db0aea5bb tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0797660
May 25 16:40:13.881849 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c1366f9-8b81-4be4-82ac-d08cf953015d req-c747755a-b756-4045-9721-769eadc6545b tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:13.882626 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-1c1366f9-8b81-4be4-82ac-d08cf953015d req-c747755a-b756-4045-9721-769eadc6545b tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Synchronizing usage tracker for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:40:13.900809 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-1c1366f9-8b81-4be4-82ac-d08cf953015d req-c747755a-b756-4045-9721-769eadc6545b tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Unset dirty status for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:40:13.902248 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-1c1366f9-8b81-4be4-82ac-d08cf953015d req-c747755a-b756-4045-9721-769eadc6545b tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 945 time: 0.1119907
May 25 16:40:14.042243 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:14.136129 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-1c1366f9-8b81-4be4-82ac-d08cf953015d req-357bd0ee-ead5-4409-84c2-c7fa8977d855 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Deleting port 7b0a5381-d69e-445c-9ee0-f4004f815424 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:40:14.136478 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-1c1366f9-8b81-4be4-82ac-d08cf953015d req-357bd0ee-ead5-4409-84c2-c7fa8977d855 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:14.270894 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499e2162-dfde-475f-96b0-da10db581479 req-ef2e3b04-0802-45b6-b85c-1d894417d08d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:14.272415 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-499e2162-dfde-475f-96b0-da10db581479 req-ef2e3b04-0802-45b6-b85c-1d894417d08d tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1013024
May 25 16:40:14.327523 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dd764af-9bd6-4e08-a9ab-b84ee3076873 req-96d510a2-eb25-44d2-abfa-c314ef8a1ec5 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:14.327523 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7dd764af-9bd6-4e08-a9ab-b84ee3076873 req-96d510a2-eb25-44d2-abfa-c314ef8a1ec5 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=11d77487-53d2-4c41-bad4-58b31f6ad1f9 HTTP/1.1" status: 200  len: 945 time: 0.2093377
May 25 16:40:14.337476 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-1c1366f9-8b81-4be4-82ac-d08cf953015d req-357bd0ee-ead5-4409-84c2-c7fa8977d855 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] For port 7b0a5381-d69e-445c-9ee0-f4004f815424, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7b0a5381-d69e-445c-9ee0-f4004f815424,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:14.337476 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-1c1366f9-8b81-4be4-82ac-d08cf953015d req-357bd0ee-ead5-4409-84c2-c7fa8977d855 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:14.363552 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-499e2162-dfde-475f-96b0-da10db581479 req-d007c42f-bd70-4430-a16a-577c4bc2c903 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0828094
May 25 16:40:14.377351 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7dd764af-9bd6-4e08-a9ab-b84ee3076873 req-18b5daa1-7e20-481f-881e-fd39295e9c77 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0544891
May 25 16:40:14.543606 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-1c1366f9-8b81-4be4-82ac-d08cf953015d req-357bd0ee-ead5-4409-84c2-c7fa8977d855 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Calling delete_port for 7b0a5381-d69e-445c-9ee0-f4004f815424 owned by compute:nova {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:40:14.752590 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-1c1366f9-8b81-4be4-82ac-d08cf953015d req-357bd0ee-ead5-4409-84c2-c7fa8977d855 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:14.768221 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['39034fee-da76-49d9-a359-2be89ce60575', 'dc96a24c-e6ea-4174-9a11-ac0ae925b8fb'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:40:14.785560 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:14.867723 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-357bd0ee-ead5-4409-84c2-c7fa8977d855 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Pushing event deleted for resources: {'Port': ['ID=7b0a5381-d69e-445c-9ee0-f4004f815424,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:14.950207 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-357bd0ee-ead5-4409-84c2-c7fa8977d855 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:14.951323 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [req-1c1366f9-8b81-4be4-82ac-d08cf953015d req-357bd0ee-ead5-4409-84c2-c7fa8977d855 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] No DVR routers for this DVR port 7b0a5381-d69e-445c-9ee0-f4004f815424 on host hv-cinder-78638 {{(pid=92012) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:40:14.955644 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-1c1366f9-8b81-4be4-82ac-d08cf953015d req-357bd0ee-ead5-4409-84c2-c7fa8977d855 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:14.959069 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '11d77487-53d2-4c41-bad4-58b31f6ad1f9', 'name': 'network-vif-deleted', 'tag': '7b0a5381-d69e-445c-9ee0-f4004f815424'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:40:14.984169 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-1c1366f9-8b81-4be4-82ac-d08cf953015d req-357bd0ee-ead5-4409-84c2-c7fa8977d855 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "DELETE /v2.0/ports/7b0a5381-d69e-445c-9ee0-f4004f815424 HTTP/1.1" status: 204  len: 173 time: 1.0744128
May 25 16:40:15.185317 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-89ee6c3b-ee24-4cc7-a504-2bebcca4d4c8 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-776775645&fields=id&tenant_id=a723bbfba23f463dbb8da0bdacb4b0aa HTTP/1.1" status: 200  len: 267 time: 0.1108541
May 25 16:40:15.245784 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '11d77487-53d2-4c41-bad4-58b31f6ad1f9', 'name': 'network-vif-deleted', 'tag': '7b0a5381-d69e-445c-9ee0-f4004f815424', 'status': 'completed', 'code': 200}
May 25 16:40:15.504924 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-356ac53b-88d6-4441-bf7e-5653b1d19ccd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:15.508577 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-356ac53b-88d6-4441-bf7e-5653b1d19ccd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/networks?id=3e40698a-e2cb-4812-9711-e3b481dbc8b3 HTTP/1.1" status: 200  len: 809 time: 0.3161726
May 25 16:40:15.539977 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c6aef8dc-df4b-4c8f-9ea9-8f9e87561ba4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/quotas/a723bbfba23f463dbb8da0bdacb4b0aa HTTP/1.1" status: 200  len: 375 time: 0.0187166
May 25 16:40:15.562636 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8cd76d3-304b-4bf3-9e56-2eb0276d4f74 req-ea18aab7-3a80-49dd-a5f5-2237ebce2ff2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:15.565325 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e8cd76d3-304b-4bf3-9e56-2eb0276d4f74 req-ea18aab7-3a80-49dd-a5f5-2237ebce2ff2 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=fe57668427364ea7acb08a0f7f2826ed&device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 1099 time: 0.2717898
May 25 16:40:15.639516 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dcc95d1-941a-4a4e-9450-597a94b75a52 req-f2545940-59bc-43cc-84bd-36f22620d139 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:15.647377 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5dcc95d1-941a-4a4e-9450-597a94b75a52 req-f2545940-59bc-43cc-84bd-36f22620d139 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1964071
May 25 16:40:15.697950 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5dcc95d1-941a-4a4e-9450-597a94b75a52 req-8fc427aa-b8a3-4933-94c9-879057afd135 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0496190
May 25 16:40:15.729041 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-4e0734b4-54fb-4d16-b72c-c91b6e31b614 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=a723bbfba23f463dbb8da0bdacb4b0aa&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1875966
May 25 16:40:15.816845 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8cd76d3-304b-4bf3-9e56-2eb0276d4f74 req-0cb76499-e1d2-4a01-b00b-a1adb99db1cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:15.819113 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e8cd76d3-304b-4bf3-9e56-2eb0276d4f74 req-0cb76499-e1d2-4a01-b00b-a1adb99db1cb service neutron] 10.222.0.76 "GET /v2.0/networks?id=1186d694-166f-4246-b68b-e7ce60cb0f02 HTTP/1.1" status: 200  len: 918 time: 0.2441716
May 25 16:40:15.916742 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e8cd76d3-304b-4bf3-9e56-2eb0276d4f74 req-7ffe77b7-1b62-4a3a-9435-0bb3e072af2c service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d HTTP/1.1" status: 200  len: 217 time: 0.0807660
May 25 16:40:15.941985 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-b8be34dc-6cb2-41fe-91a2-09e047f1575c service neutron] 10.222.0.73 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2124929
May 25 16:40:16.016082 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8cd76d3-304b-4bf3-9e56-2eb0276d4f74 req-bea79b4d-6567-46c4-ad82-a49f3c92b49b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:16.017585 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e8cd76d3-304b-4bf3-9e56-2eb0276d4f74 req-bea79b4d-6567-46c4-ad82-a49f3c92b49b service neutron] 10.222.0.76 "GET /v2.0/subnets?id=5e6146eb-31ff-437b-a594-8ddb1d63042e HTTP/1.1" status: 200  len: 857 time: 0.0897105
May 25 16:40:16.081081 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e8cd76d3-304b-4bf3-9e56-2eb0276d4f74 req-77010b58-daf4-4a14-be3c-e24bf91c1d46 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=1186d694-166f-4246-b68b-e7ce60cb0f02&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0553482
May 25 16:40:16.217020 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-a126772d-9534-4fe5-a9b1-faef5f99cf07 service neutron] 10.222.0.73 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2741027
May 25 16:40:16.309480 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e8cd76d3-304b-4bf3-9e56-2eb0276d4f74 req-3ec8eff2-8a6c-4905-b76b-7418142b64f8 service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2181149
May 25 16:40:16.386399 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 7b0a5381-d69e-445c-9ee0-f4004f815424 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:40:16.472525 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 7b0a5381-d69e-445c-9ee0-f4004f815424 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:40:16.472880 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 7b0a5381-d69e-445c-9ee0-f4004f815424 not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:40:16.502566 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:40:16.595945 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e8cd76d3-304b-4bf3-9e56-2eb0276d4f74 req-364278cc-471f-4fd0-a652-d3dee09310f1 service neutron] 10.222.0.76 "GET /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2765629
May 25 16:40:16.618684 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cb4e5ed-0308-45f5-9550-2ef16f358b06 req-b94df62f-a3ac-4fca-9683-055467ec72ce tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:16.620965 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2cb4e5ed-0308-45f5-9550-2ef16f358b06 req-b94df62f-a3ac-4fca-9683-055467ec72ce tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 946 time: 0.1042902
May 25 16:40:16.681499 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2cb4e5ed-0308-45f5-9550-2ef16f358b06 req-b7806fd8-37bf-40de-881c-5ff39580dec1 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0516331
May 25 16:40:16.826980 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c9f8194d-5c1a-4398-91f8-e1e1cab9f0ab req-b01042e0-b9f7-4e0f-b246-320fbbf190f4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 210 time: 0.0931287
May 25 16:40:16.942950 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f408ac-7dd1-428d-9785-deb51e5427e1 req-06e65ce3-50a8-4776-9927-dd0d467b3f77 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:16.945461 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b8f408ac-7dd1-428d-9785-deb51e5427e1 req-06e65ce3-50a8-4776-9927-dd0d467b3f77 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1061904
May 25 16:40:17.017383 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b8f408ac-7dd1-428d-9785-deb51e5427e1 req-f1be7cdc-c604-4197-85a4-25513d4d7495 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0588319
May 25 16:40:17.932482 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65bc4043-4024-468a-9f55-46cc23df1f66 req-59dc73b5-a70b-48b1-9d57-de1612f68fda tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:17.934793 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-65bc4043-4024-468a-9f55-46cc23df1f66 req-59dc73b5-a70b-48b1-9d57-de1612f68fda tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 946 time: 0.1203840
May 25 16:40:18.034271 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-65bc4043-4024-468a-9f55-46cc23df1f66 req-b58e7485-1eac-4ee1-b785-66d0ab6c8c68 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0935574
May 25 16:40:18.057751 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-624ec13f-d505-41cc-b7e6-3bc141369d31 req-c8a36ab1-504e-4652-83e2-175f37c6e873 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 210 time: 0.0854998
May 25 16:40:18.317457 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-b96e41e4-7584-41a0-bad9-63b2674f120c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:18.319089 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-b96e41e4-7584-41a0-bad9-63b2674f120c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Synchronizing usage tracker for tenant:a723bbfba23f463dbb8da0bdacb4b0aa on resource:network {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:40:18.344183 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-b96e41e4-7584-41a0-bad9-63b2674f120c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Unset dirty status for tenant:a723bbfba23f463dbb8da0bdacb4b0aa on resource:network {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:40:18.354358 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-b96e41e4-7584-41a0-bad9-63b2674f120c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.76 "GET /v2.0/networks?id=3e40698a-e2cb-4812-9711-e3b481dbc8b3 HTTP/1.1" status: 200  len: 809 time: 0.2845936
May 25 16:40:18.436402 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-0338d20a-ff7e-428e-9a58-476afe14be1d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Synchronizing usage tracker for tenant:a723bbfba23f463dbb8da0bdacb4b0aa on resource:security_group {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:40:18.452310 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab32558-79f6-417d-bdd5-d2bdeebc3b83 req-fe312db7-8926-4958-a545-05a5d99ff18b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:18.455041 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1ab32558-79f6-417d-bdd5-d2bdeebc3b83 req-fe312db7-8926-4958-a545-05a5d99ff18b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.2711782
May 25 16:40:18.469610 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de7925a-20a5-4a50-9d14-efa151c93353 req-6e46a086-b721-44cc-92a2-8f991c667af9 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:18.472855 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0de7925a-20a5-4a50-9d14-efa151c93353 req-6e46a086-b721-44cc-92a2-8f991c667af9 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 946 time: 0.1987302
May 25 16:40:18.480377 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-0338d20a-ff7e-428e-9a58-476afe14be1d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Unset dirty status for tenant:a723bbfba23f463dbb8da0bdacb4b0aa on resource:security_group {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:40:18.485445 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-0338d20a-ff7e-428e-9a58-476afe14be1d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a723bbfba23f463dbb8da0bdacb4b0aa HTTP/1.1" status: 200  len: 379 time: 0.1260107
May 25 16:40:18.496232 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Request body: {'port': {'device_id': '550a76ba-233b-4d54-8223-01267bd33511', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'admin_state_up': True, 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'security_groups': ['c290da32-99a9-4156-b987-67e510a15d61']}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:40:18.701550 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1ab32558-79f6-417d-bdd5-d2bdeebc3b83 req-f46015f0-ccec-441a-a5f4-fc89fb0567d1 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1624422
May 25 16:40:18.770429 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-0de7925a-20a5-4a50-9d14-efa151c93353 req-11232ff6-4786-49e6-ad90-8f787e22e63a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Deleting port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:40:18.770933 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0de7925a-20a5-4a50-9d14-efa151c93353 req-11232ff6-4786-49e6-ad90-8f787e22e63a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:18.808381 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:40:18.813173 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Usage tracker for resource:port and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:40:18.816891 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:40:18.824092 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:40:18.839629 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Made reservation on behalf of a723bbfba23f463dbb8da0bdacb4b0aa for: {'port': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:40:18.843585 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:18.944665 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-0de7925a-20a5-4a50-9d14-efa151c93353 req-11232ff6-4786-49e6-ad90-8f787e22e63a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] For port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=dc96a24c-e6ea-4174-9a11-ac0ae925b8fb,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:18.945309 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0de7925a-20a5-4a50-9d14-efa151c93353 req-11232ff6-4786-49e6-ad90-8f787e22e63a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:19.059618 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Allocated IP 172.20.0.8 (3e40698a-e2cb-4812-9711-e3b481dbc8b3/6203ecab-ef7b-4872-ac7a-33ea4cfae323/f9f25895-4aec-487b-bcc9-f61318cb3aba) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:40:19.087741 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-0de7925a-20a5-4a50-9d14-efa151c93353 req-11232ff6-4786-49e6-ad90-8f787e22e63a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Calling delete_port for dc96a24c-e6ea-4174-9a11-ac0ae925b8fb owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:40:19.323594 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-153707e5-c8e1-4f59-ba84-b9b178577302 req-d19c993d-f4f7-437c-a126-b71f36ba26ba tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 210 time: 0.0508184
May 25 16:40:19.364439 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0de7925a-20a5-4a50-9d14-efa151c93353 req-11232ff6-4786-49e6-ad90-8f787e22e63a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:19.373419 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6c1eb26d-2e6f-44f9-b1fe-f95e961f80e7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:19.380319 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['39034fee-da76-49d9-a359-2be89ce60575', 'dc96a24c-e6ea-4174-9a11-ac0ae925b8fb'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:40:19.476548 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11232ff6-4786-49e6-ad90-8f787e22e63a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Pushing event deleted for resources: {'Port': ['ID=dc96a24c-e6ea-4174-9a11-ac0ae925b8fb,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:19.480973 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:19.484174 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-11232ff6-4786-49e6-ad90-8f787e22e63a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:19.528007 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Transition to ACTIVE for port object f9f25895-4aec-487b-bcc9-f61318cb3aba will not be triggered until provisioned by entity DHCP. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:40:19.581830 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:19.591889 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-0de7925a-20a5-4a50-9d14-efa151c93353 req-11232ff6-4786-49e6-ad90-8f787e22e63a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] No DVR routers for this DVR port dc96a24c-e6ea-4174-9a11-ac0ae925b8fb on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:40:19.594774 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0de7925a-20a5-4a50-9d14-efa151c93353 req-11232ff6-4786-49e6-ad90-8f787e22e63a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:19.598536 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7a55b0de-f317-4aab-ae18-b473e1578d49 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:19.605674 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31786e99-b18d-4a80-9959-28c18ca63fd3', 'name': 'network-vif-deleted', 'tag': 'dc96a24c-e6ea-4174-9a11-ac0ae925b8fb'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:40:19.611421 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0de7925a-20a5-4a50-9d14-efa151c93353 req-11232ff6-4786-49e6-ad90-8f787e22e63a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "DELETE /v2.0/ports/dc96a24c-e6ea-4174-9a11-ac0ae925b8fb HTTP/1.1" status: 204  len: 173 time: 1.1319258
May 25 16:40:19.621059 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48135caa-b1ac-424a-a528-c4329f142076 req-5ad3f64a-3e81-4dbc-9d07-16899e824f10 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:19.622249 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-48135caa-b1ac-424a-a528-c4329f142076 req-5ad3f64a-3e81-4dbc-9d07-16899e824f10 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Synchronizing usage tracker for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:40:19.649633 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-48135caa-b1ac-424a-a528-c4329f142076 req-5ad3f64a-3e81-4dbc-9d07-16899e824f10 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Unset dirty status for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:40:19.651294 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-48135caa-b1ac-424a-a528-c4329f142076 req-5ad3f64a-3e81-4dbc-9d07-16899e824f10 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=31786e99-b18d-4a80-9959-28c18ca63fd3 HTTP/1.1" status: 200  len: 946 time: 0.4260833
May 25 16:40:19.700784 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-48135caa-b1ac-424a-a528-c4329f142076 req-064b42fb-eca9-440e-8a65-e531450bcd9a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0423207
May 25 16:40:19.701645 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:40:19.711841 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:40:19.730313 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:40:19.731935 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '31786e99-b18d-4a80-9959-28c18ca63fd3', 'name': 'network-vif-deleted', 'tag': 'dc96a24c-e6ea-4174-9a11-ac0ae925b8fb', 'status': 'completed', 'code': 200}
May 25 16:40:19.833373 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Pushing event updated for resources: {'Port': ['ID=f9f25895-4aec-487b-bcc9-f61318cb3aba,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:19.845298 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.246s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:19.870472 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:19.871252 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:19.902565 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4147840
May 25 16:40:19.933804 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Request body: {'port': {'device_id': '550a76ba-233b-4d54-8223-01267bd33511', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:40:19.947035 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e69857-a78a-4c05-915a-806cb172762c req-e235b4ba-b25e-4f1d-833a-213c99d316b2 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:19.948563 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-82e69857-a78a-4c05-915a-806cb172762c req-e235b4ba-b25e-4f1d-833a-213c99d316b2 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1152720
May 25 16:40:19.996404 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-82e69857-a78a-4c05-915a-806cb172762c req-ab93a440-6670-4c73-a994-5141bcf37e6c tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417051
May 25 16:40:20.054691 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-321d746a-67fe-43eb-a989-0611c8f3ed79 None None] Provisioning for port f9f25895-4aec-487b-bcc9-f61318cb3aba completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:40:20.066928 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-321d746a-67fe-43eb-a989-0611c8f3ed79 None None] Provisioning complete for port f9f25895-4aec-487b-bcc9-f61318cb3aba triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:40:20.067193 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-321d746a-67fe-43eb-a989-0611c8f3ed79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:20.078042 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:20.131701 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-321d746a-67fe-43eb-a989-0611c8f3ed79 None None] Port f9f25895-4aec-487b-bcc9-f61318cb3aba cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:40:20.860362 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b42712c-2392-48ec-a993-650ba04dbf85 req-8b6a2154-b453-4006-92ce-5f6188ab221d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:20.881749 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5b42712c-2392-48ec-a993-650ba04dbf85 req-8b6a2154-b453-4006-92ce-5f6188ab221d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 931 time: 0.2898583
May 25 16:40:20.972626 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5b42712c-2392-48ec-a993-650ba04dbf85 req-b093147e-b16c-4130-bba0-c79b545238e9 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0899940
May 25 16:40:20.976266 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f9f25895-4aec-487b-bcc9-f61318cb3aba {{(pid=92012) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:40:20.985047 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:21.005643 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Transition to ACTIVE for port object f9f25895-4aec-487b-bcc9-f61318cb3aba will not be triggered until provisioned by entity L2. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:40:21.015795 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:21.028597 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-9b54f144-b989-425a-9861-9c89cccf1540 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:21.262979 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Pushing event updated for resources: {'Port': ['ID=f9f25895-4aec-487b-bcc9-f61318cb3aba,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:21.266491 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:21.328299 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Attempting to bind port f9f25895-4aec-487b-bcc9-f61318cb3aba on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:40:21.328624 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Attempting to bind port f9f25895-4aec-487b-bcc9-f61318cb3aba by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '19ecc07e-d399-4943-af92-0daf09e9ec93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 401, 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3'}] {{(pid=92012) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:40:21.328979 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Attempting to bind port f9f25895-4aec-487b-bcc9-f61318cb3aba on network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:40:21.341597 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Port f9f25895-4aec-487b-bcc9-f61318cb3aba on network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:40:21.341597 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Attempting to bind port f9f25895-4aec-487b-bcc9-f61318cb3aba on network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:40:21.349143 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 40, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:40:21.349741 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Checking segment: {'id': '19ecc07e-d399-4943-af92-0daf09e9ec93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 401, 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:40:21.350450 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Bound using segment: {'id': '19ecc07e-d399-4943-af92-0daf09e9ec93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 401, 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3'} {{(pid=92012) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:40:21.351064 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.managers [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Bound port: f9f25895-4aec-487b-bcc9-f61318cb3aba, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '19ecc07e-d399-4943-af92-0daf09e9ec93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 401, 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3'}}] {{(pid=92012) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:40:21.351599 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:21.486490 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] For port f9f25895-4aec-487b-bcc9-f61318cb3aba, host hv-cinder-78638, cleared binding levels {{(pid=92012) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:40:21.489785 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] For port f9f25895-4aec-487b-bcc9-f61318cb3aba, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92012) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:40:21.496285 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:21.501634 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-acc3b3f1-7da2-489c-92cf-2c67d0e4b7ab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:21.575652 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:21.576360 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:21.577709 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] 10.222.0.76 "PUT /v2.0/ports/f9f25895-4aec-487b-bcc9-f61318cb3aba HTTP/1.1" status: 200  len: 1093 time: 1.6548824
May 25 16:40:21.588087 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:40:21.674128 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'status': 'completed', 'code': 200}
May 25 16:40:21.697688 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Pushing event updated for resources: {'Port': ['ID=f9f25895-4aec-487b-bcc9-f61318cb3aba,revision_number=3']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:21.701258 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:21.734374 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-0792746e-ef6d-4e1d-8dae-7a5f5428d651 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:21.735845 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-0792746e-ef6d-4e1d-8dae-7a5f5428d651 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a723bbfba23f463dbb8da0bdacb4b0aa&device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 1096 time: 0.1041832
May 25 16:40:21.850065 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-088cb806-9de0-46f8-b280-e4775f5fa254 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba HTTP/1.1" status: 200  len: 217 time: 0.1001713
May 25 16:40:22.014502 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-346a4a21-e842-47c7-84e6-6f08baa0255b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:22.018238 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-346a4a21-e842-47c7-84e6-6f08baa0255b service neutron] 10.222.0.76 "GET /v2.0/subnets?id=6203ecab-ef7b-4872-ac7a-33ea4cfae323 HTTP/1.1" status: 200  len: 848 time: 0.1523390
May 25 16:40:22.168748 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-ed85416e-2c4b-42be-9018-163e3dc8d5a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:22.170853 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-ed85416e-2c4b-42be-9018-163e3dc8d5a9 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=3e40698a-e2cb-4812-9711-e3b481dbc8b3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1406610
May 25 16:40:22.407492 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-77245556-4664-4f79-b933-d6530f004f53 service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2282848
May 25 16:40:22.413166 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device dc96a24c-e6ea-4174-9a11-ac0ae925b8fb no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:40:22.433218 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11a0781c-debc-4d38-8415-14c62706fc22 req-d881c8a3-3e9c-4eb7-88cc-d74805ea5031 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:22.434974 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-11a0781c-debc-4d38-8415-14c62706fc22 req-d881c8a3-3e9c-4eb7-88cc-d74805ea5031 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.2467508
May 25 16:40:22.526697 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: dc96a24c-e6ea-4174-9a11-ac0ae925b8fb {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:40:22.527048 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device dc96a24c-e6ea-4174-9a11-ac0ae925b8fb not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:40:22.530794 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-11a0781c-debc-4d38-8415-14c62706fc22 req-77097e06-23e3-408d-942a-25e73c322e48 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0892298
May 25 16:40:22.627346 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-dc8afee3-4be9-4f01-b187-51aa9c1d889c req-321785bb-2440-4d63-87af-c5c9ae157a8b service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2122064
May 25 16:40:22.806532 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1d36f3a-3206-458f-b2d6-93f67a781efb req-5aecc49e-b625-44a3-b215-ce58535094f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:22.808097 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e1d36f3a-3206-458f-b2d6-93f67a781efb req-5aecc49e-b625-44a3-b215-ce58535094f3 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a723bbfba23f463dbb8da0bdacb4b0aa&device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 1096 time: 0.1179588
May 25 16:40:22.961073 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-679ba3da-6614-45ef-8e70-fa7ae64b7f82 req-77c8dffa-5bdc-43f1-b49e-e33a9d2a1ef9 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:22.962968 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-679ba3da-6614-45ef-8e70-fa7ae64b7f82 req-77c8dffa-5bdc-43f1-b49e-e33a9d2a1ef9 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 945 time: 0.0997376
May 25 16:40:22.971105 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1d36f3a-3206-458f-b2d6-93f67a781efb req-fd1a6c55-bd43-449a-8f57-6550c7e18280 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:22.972632 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e1d36f3a-3206-458f-b2d6-93f67a781efb req-fd1a6c55-bd43-449a-8f57-6550c7e18280 service neutron] 10.222.0.76 "GET /v2.0/networks?id=3e40698a-e2cb-4812-9711-e3b481dbc8b3 HTTP/1.1" status: 200  len: 910 time: 0.1560791
May 25 16:40:23.015145 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-679ba3da-6614-45ef-8e70-fa7ae64b7f82 req-25901876-9852-4c76-9548-33727e371d60 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0452251
May 25 16:40:23.058460 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e1d36f3a-3206-458f-b2d6-93f67a781efb req-bfc73d52-704e-43a4-bb02-061cb9bae351 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba HTTP/1.1" status: 200  len: 217 time: 0.0782239
May 25 16:40:23.267468 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1d36f3a-3206-458f-b2d6-93f67a781efb req-b4ca36a0-bcc8-4cb2-8b88-2deb20faee70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:23.268940 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e1d36f3a-3206-458f-b2d6-93f67a781efb req-b4ca36a0-bcc8-4cb2-8b88-2deb20faee70 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=6203ecab-ef7b-4872-ac7a-33ea4cfae323 HTTP/1.1" status: 200  len: 848 time: 0.2015035
May 25 16:40:23.399175 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1d36f3a-3206-458f-b2d6-93f67a781efb req-00f3ac6e-9432-4403-afd9-3c2c72a33bb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:23.400747 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e1d36f3a-3206-458f-b2d6-93f67a781efb req-00f3ac6e-9432-4403-afd9-3c2c72a33bb4 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=3e40698a-e2cb-4812-9711-e3b481dbc8b3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1240835
May 25 16:40:23.578372 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e1d36f3a-3206-458f-b2d6-93f67a781efb req-73260393-6a66-4a9d-be4c-217f87900a8e service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1687121
May 25 16:40:23.780581 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e1d36f3a-3206-458f-b2d6-93f67a781efb req-1706eb94-888d-479f-a1e1-f524396a1ede service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1946180
May 25 16:40:23.826337 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-887f8b29-fe68-4599-9e94-4e5b0c480608 req-62c081b0-0090-4f7f-b3ca-1dbb88bddadd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:23.828547 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-887f8b29-fe68-4599-9e94-4e5b0c480608 req-62c081b0-0090-4f7f-b3ca-1dbb88bddadd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.0938671
May 25 16:40:23.881428 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-887f8b29-fe68-4599-9e94-4e5b0c480608 req-b96d2914-c73f-4fee-a093-e6f91143e3d9 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0462811
May 25 16:40:24.266597 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94f9a508-5adf-4c05-bed4-5930d464daeb req-1bbb7eb5-328d-4e62-8d84-eb4107f679ca tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:24.269086 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-94f9a508-5adf-4c05-bed4-5930d464daeb req-1bbb7eb5-328d-4e62-8d84-eb4107f679ca tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 945 time: 0.1349342
May 25 16:40:24.331376 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-94f9a508-5adf-4c05-bed4-5930d464daeb req-e3bd5331-82a1-46db-8b5b-e08ad513a53e tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0531499
May 25 16:40:24.914915 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5481e65-a26a-462a-a892-3e4131173ca0 req-7aa965a2-70ce-4560-9389-6734822b7caa tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:24.916216 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-e5481e65-a26a-462a-a892-3e4131173ca0 req-7aa965a2-70ce-4560-9389-6734822b7caa tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Synchronizing usage tracker for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:40:24.930879 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-e5481e65-a26a-462a-a892-3e4131173ca0 req-7aa965a2-70ce-4560-9389-6734822b7caa tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Unset dirty status for tenant:2441ab18acee4d4c9e276ba69a458348 on resource:port {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:40:24.931996 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e5481e65-a26a-462a-a892-3e4131173ca0 req-7aa965a2-70ce-4560-9389-6734822b7caa tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 945 time: 0.1646581
May 25 16:40:25.137360 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-e5481e65-a26a-462a-a892-3e4131173ca0 req-8e1804af-9811-4d23-a0c3-935683f76fd4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Deleting port 39034fee-da76-49d9-a359-2be89ce60575 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:40:25.138137 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-e5481e65-a26a-462a-a892-3e4131173ca0 req-8e1804af-9811-4d23-a0c3-935683f76fd4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:25.184318 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a37289-c21c-432b-9b43-629860f2df60 req-73f8f48b-9f08-4667-a953-917e4a3a67c3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:25.194715 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e4a37289-c21c-432b-9b43-629860f2df60 req-73f8f48b-9f08-4667-a953-917e4a3a67c3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.1408896
May 25 16:40:25.298123 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-e5481e65-a26a-462a-a892-3e4131173ca0 req-8e1804af-9811-4d23-a0c3-935683f76fd4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] For port 39034fee-da76-49d9-a359-2be89ce60575, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=39034fee-da76-49d9-a359-2be89ce60575,segment=NetworkSegment(d911a8d2-c389-4e64-97ed-8ffeb60c5e38),segment_id=d911a8d2-c389-4e64-97ed-8ffeb60c5e38)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:25.298683 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-e5481e65-a26a-462a-a892-3e4131173ca0 req-8e1804af-9811-4d23-a0c3-935683f76fd4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:25.309993 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e4a37289-c21c-432b-9b43-629860f2df60 req-9290e614-4d05-4be2-b981-5a791966ea09 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1142125
May 25 16:40:25.345248 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c55b7224-6295-411a-9de7-c2215c9cf264 req-34029682-8305-441e-a0a8-36f58c2b8f88 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:25.346788 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c55b7224-6295-411a-9de7-c2215c9cf264 req-34029682-8305-441e-a0a8-36f58c2b8f88 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1344271
May 25 16:40:25.406364 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c55b7224-6295-411a-9de7-c2215c9cf264 req-30e4301e-9c48-44c0-a32b-cf1c7faa95f4 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0498476
May 25 16:40:25.498315 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-e5481e65-a26a-462a-a892-3e4131173ca0 req-8e1804af-9811-4d23-a0c3-935683f76fd4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Calling delete_port for 39034fee-da76-49d9-a359-2be89ce60575 owned by compute:nova {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:40:25.579245 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf99b87a-bbd1-44b2-912a-f24cd09a70e5 req-990159c4-9801-4c2e-b902-c442ab067178 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:25.580885 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bf99b87a-bbd1-44b2-912a-f24cd09a70e5 req-990159c4-9801-4c2e-b902-c442ab067178 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/ports?device_id=a7788ff0-f301-463e-8b35-fead9db52a0c HTTP/1.1" status: 200  len: 945 time: 0.1117015
May 25 16:40:25.641502 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-e5481e65-a26a-462a-a892-3e4131173ca0 req-8e1804af-9811-4d23-a0c3-935683f76fd4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:25.650228 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-1345f136-f76c-42a1-97ca-f72366acb2d7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:25.655008 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['39034fee-da76-49d9-a359-2be89ce60575'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:40:25.670869 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bf99b87a-bbd1-44b2-912a-f24cd09a70e5 req-3765e9f1-dcf6-4380-bc31-1751ad1a00f6 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.73 "GET /v2.0/security-groups?id=de6bed52-54c6-4c94-af8d-ee9ae4bc356c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0782678
May 25 16:40:25.713063 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e1804af-9811-4d23-a0c3-935683f76fd4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Pushing event deleted for resources: {'Port': ['ID=39034fee-da76-49d9-a359-2be89ce60575,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:25.716519 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-8e1804af-9811-4d23-a0c3-935683f76fd4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:25.801910 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5481e65-a26a-462a-a892-3e4131173ca0 req-8e1804af-9811-4d23-a0c3-935683f76fd4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] No DVR routers for this DVR port 39034fee-da76-49d9-a359-2be89ce60575 on host hv-cinder-78638 {{(pid=92012) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:40:25.805293 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-e5481e65-a26a-462a-a892-3e4131173ca0 req-8e1804af-9811-4d23-a0c3-935683f76fd4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:25.808809 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a7788ff0-f301-463e-8b35-fead9db52a0c', 'name': 'network-vif-deleted', 'tag': '39034fee-da76-49d9-a359-2be89ce60575'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:40:25.837173 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-e5481e65-a26a-462a-a892-3e4131173ca0 req-8e1804af-9811-4d23-a0c3-935683f76fd4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] 10.222.0.76 "DELETE /v2.0/ports/39034fee-da76-49d9-a359-2be89ce60575 HTTP/1.1" status: 204  len: 173 time: 0.8981783
May 25 16:40:25.874988 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a7788ff0-f301-463e-8b35-fead9db52a0c', 'name': 'network-vif-deleted', 'tag': '39034fee-da76-49d9-a359-2be89ce60575', 'status': 'completed', 'code': 200}
May 25 16:40:26.586014 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a835081-cca1-4272-bf89-4a895e25e8f6 req-4547ae2f-e300-4f37-8a1d-aeca555412ad tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:26.587593 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1a835081-cca1-4272-bf89-4a895e25e8f6 req-4547ae2f-e300-4f37-8a1d-aeca555412ad tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.1558771
May 25 16:40:26.715356 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1a835081-cca1-4272-bf89-4a895e25e8f6 req-f19b38ea-3e78-4ba4-a32e-a9b0275fb474 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0779757
May 25 16:40:26.747351 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ac730a5-bb72-4e77-aa97-da58ff964971 req-915d4e4d-569a-43c3-8b93-d8d1cf2a5872 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:26.749116 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2ac730a5-bb72-4e77-aa97-da58ff964971 req-915d4e4d-569a-43c3-8b93-d8d1cf2a5872 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1605537
May 25 16:40:26.815238 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2ac730a5-bb72-4e77-aa97-da58ff964971 req-965a0641-c1a5-498d-aea2-2c2ac6038815 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0601642
May 25 16:40:26.826754 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 55588) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:26.901006 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_v2 [None req-4e81f9ad-459a-4b5c-be4c-06e3db6dadc6 admin admin] Deleting subnet c4c2aef1-f957-410f-9038-a1d13568aa6e {{(pid=92013) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:40:26.904044 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-4e81f9ad-459a-4b5c-be4c-06e3db6dadc6 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:26.976731 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-4e81f9ad-459a-4b5c-be4c-06e3db6dadc6 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6928876'] for subnet, precommit_delete_associations {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:27.049261 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-4e81f9ad-459a-4b5c-be4c-06e3db6dadc6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:27.362422 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-4e81f9ad-459a-4b5c-be4c-06e3db6dadc6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6928756', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7156487'] for subnet, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:27.370573 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-dac22546-4d6e-432d-af38-e838058ff009 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:27.403457 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e81f9ad-459a-4b5c-be4c-06e3db6dadc6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c4c2aef1-f957-410f-9038-a1d13568aa6e,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:27.406043 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-4e81f9ad-459a-4b5c-be4c-06e3db6dadc6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:27.409968 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-4e81f9ad-459a-4b5c-be4c-06e3db6dadc6 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:27.428374 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 55596) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:27.429005 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-4e81f9ad-459a-4b5c-be4c-06e3db6dadc6 admin admin] 10.222.0.73 "DELETE /v2.0/subnets/c4c2aef1-f957-410f-9038-a1d13568aa6e HTTP/1.1" status: 204  len: 168 time: 0.6006134
May 25 16:40:27.557594 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:27.699105 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:27.713235 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346aa37f10>,) {'filters': {'network_id': ['e55be10d-206c-4bb4-8273-c9b859b11a42']}} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:27.724945 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346aa37f10>, 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38') {'for_net_delete': True} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:27.725477 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346aa37f10>, 'd911a8d2-c389-4e64-97ed-8ffeb60c5e38') {} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:27.775421 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-976068'] for segment, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:27.798265 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:27.807625 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Releasing vlan 410 on physical network physnet1 to pool {{(pid=92012) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:40:27.808011 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7823239'] for segment, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]: Traceback (most recent call last):
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     timer()
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     cb(*args, **kw)
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     return func(*args, **kwargs)
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     self._notify()
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     self.callback(batched_events)
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     event.method(event)
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     return f(self, *a, **k)
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._get(url).json()
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self.request(url, 'GET', **kwargs)
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:40:27.821508 dv-cinder-786386-6-iscsi neutron-server[92012]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:40:27.937127 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af3b01d-9d18-4ad1-a9c5-fc2770ac3f1b req-0ad42000-9a81-4737-a2c8-58d4311acaf5 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:27.938662 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1af3b01d-9d18-4ad1-a9c5-fc2770ac3f1b req-0ad42000-9a81-4737-a2c8-58d4311acaf5 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.1146336
May 25 16:40:28.014423 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d8d2e41-6857-4bd7-832b-380ec84cd576 req-a537f7c0-bc16-4cd7-80ff-2b6c8bf4bf17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:28.015123 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-1d8d2e41-6857-4bd7-832b-380ec84cd576 req-a537f7c0-bc16-4cd7-80ff-2b6c8bf4bf17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Synchronizing usage tracker for tenant:fe57668427364ea7acb08a0f7f2826ed on resource:port {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:40:28.019310 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:28.029542 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:28.037708 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1af3b01d-9d18-4ad1-a9c5-fc2770ac3f1b req-c08c7cfd-3e82-440a-86b4-bce563f5fd1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0634971
May 25 16:40:28.042403 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:28.055918 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-1d8d2e41-6857-4bd7-832b-380ec84cd576 req-a537f7c0-bc16-4cd7-80ff-2b6c8bf4bf17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Unset dirty status for tenant:fe57668427364ea7acb08a0f7f2826ed on resource:port {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:40:28.057042 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-1d8d2e41-6857-4bd7-832b-380ec84cd576 req-a537f7c0-bc16-4cd7-80ff-2b6c8bf4bf17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.76 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.3253922
May 25 16:40:28.057831 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Pushing event deleted for resources: {'Network': ['ID=e55be10d-206c-4bb4-8273-c9b859b11a42,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:28.062180 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ead563-fc2b-4b78-b62c-326352f80fbe req-a9c5fc65-f458-49ae-bfd6-10a6e5bc2bc6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:28.063409 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b2ead563-fc2b-4b78-b62c-326352f80fbe req-a9c5fc65-f458-49ae-bfd6-10a6e5bc2bc6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 945 time: 0.1205668
May 25 16:40:28.100789 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:28.101163 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:28.101552 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:28.101908 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:28.102262 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:28.102613 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:28.102961 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:28.103308 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:28.103654 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:28.103997 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:28.104337 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:28.104674 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:28.109461 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b2ead563-fc2b-4b78-b62c-326352f80fbe req-faea909f-a6c0-4851-8fb1-97260662e2b8 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383468
May 25 16:40:28.112858 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:28.114216 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-bd054dfe-ae65-457f-8b6d-d3cf1cbb6e84 admin admin] 10.222.0.73 "DELETE /v2.0/networks/e55be10d-206c-4bb4-8273-c9b859b11a42 HTTP/1.1" status: 204  len: 168 time: 0.6839285
May 25 16:40:28.213612 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-1d8d2e41-6857-4bd7-832b-380ec84cd576 req-ae473953-3499-4579-9216-83c905ab2b17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Deleting port 7ed91548-e01f-419a-904f-ecf099335405 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:40:28.213953 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-1d8d2e41-6857-4bd7-832b-380ec84cd576 req-ae473953-3499-4579-9216-83c905ab2b17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:28.353193 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 55628) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:28.354919 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-1d8d2e41-6857-4bd7-832b-380ec84cd576 req-ae473953-3499-4579-9216-83c905ab2b17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] For port 7ed91548-e01f-419a-904f-ecf099335405, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7ed91548-e01f-419a-904f-ecf099335405,segment=NetworkSegment(227f55be-6fbd-4206-b845-6ee4d0737571),segment_id=227f55be-6fbd-4206-b845-6ee4d0737571)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:28.355592 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-1d8d2e41-6857-4bd7-832b-380ec84cd576 req-ae473953-3499-4579-9216-83c905ab2b17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:28.413886 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-b6c1e11d-9aa3-4a46-bbbd-6cf96ac64e9a admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=2441ab18acee4d4c9e276ba69a458348&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0590892
May 25 16:40:28.416167 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 55632) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:28.440577 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 39034fee-da76-49d9-a359-2be89ce60575 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:40:28.475111 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7ef550df-f7b3-4c58-a605-33005554c3f3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:28.479470 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 39034fee-da76-49d9-a359-2be89ce60575 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:40:28.479957 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 39034fee-da76-49d9-a359-2be89ce60575 not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:40:28.480467 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 7ed91548-e01f-419a-904f-ecf099335405 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:40:28.501561 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7ef550df-f7b3-4c58-a605-33005554c3f3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:28.503217 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-1d8d2e41-6857-4bd7-832b-380ec84cd576 req-ae473953-3499-4579-9216-83c905ab2b17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Calling delete_port for 7ed91548-e01f-419a-904f-ecf099335405 owned by compute:nova {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:40:28.559332 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7ef550df-f7b3-4c58-a605-33005554c3f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:28.566077 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c9e215ea-b6b9-402e-b8ea-14c95f2343c4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:28.579619 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7ef550df-f7b3-4c58-a605-33005554c3f3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:28.581864 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-7ef550df-f7b3-4c58-a605-33005554c3f3 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/de6bed52-54c6-4c94-af8d-ee9ae4bc356c HTTP/1.1" status: 204  len: 168 time: 0.1647553
May 25 16:40:28.583687 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ef550df-f7b3-4c58-a605-33005554c3f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de6bed52-54c6-4c94-af8d-ee9ae4bc356c,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:28.593186 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-7ef550df-f7b3-4c58-a605-33005554c3f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:28.606947 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:28.638253 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-1d8d2e41-6857-4bd7-832b-380ec84cd576 req-ae473953-3499-4579-9216-83c905ab2b17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:28.644622 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b0c025de-c32a-40e5-a755-65fbebac9015 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:28.670929 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:40:28.691191 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae473953-3499-4579-9216-83c905ab2b17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Pushing event deleted for resources: {'Port': ['ID=7ed91548-e01f-419a-904f-ecf099335405,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:28.696003 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ae473953-3499-4579-9216-83c905ab2b17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:28.791524 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [req-1d8d2e41-6857-4bd7-832b-380ec84cd576 req-ae473953-3499-4579-9216-83c905ab2b17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] No DVR routers for this DVR port 7ed91548-e01f-419a-904f-ecf099335405 on host hv-cinder-78638 {{(pid=92012) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:40:28.797365 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-1d8d2e41-6857-4bd7-832b-380ec84cd576 req-ae473953-3499-4579-9216-83c905ab2b17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:28.800315 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cb30f9c9-3f47-4ce1-afd8-5adc008a649a', 'name': 'network-vif-deleted', 'tag': '7ed91548-e01f-419a-904f-ecf099335405'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:40:28.824648 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-1d8d2e41-6857-4bd7-832b-380ec84cd576 req-ae473953-3499-4579-9216-83c905ab2b17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.76 "DELETE /v2.0/ports/7ed91548-e01f-419a-904f-ecf099335405 HTTP/1.1" status: 204  len: 173 time: 0.7576725
May 25 16:40:28.870531 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cb30f9c9-3f47-4ce1-afd8-5adc008a649a', 'name': 'network-vif-deleted', 'tag': '7ed91548-e01f-419a-904f-ecf099335405', 'status': 'completed', 'code': 200}
May 25 16:40:29.368446 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-525dbc24-bf79-4bbb-bd8d-75af3b48f2df req-761366ce-b29a-41c0-b06b-f1210c335242 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=cb30f9c9-3f47-4ce1-afd8-5adc008a649a HTTP/1.1" status: 200  len: 210 time: 0.0580697
May 25 16:40:29.457596 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b546e872-d736-4113-bdb3-3fe403c6426f req-f9a60564-44c2-479b-b240-f07b52eab303 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:29.468370 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b546e872-d736-4113-bdb3-3fe403c6426f req-f9a60564-44c2-479b-b240-f07b52eab303 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.3090973
May 25 16:40:29.523695 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b546e872-d736-4113-bdb3-3fe403c6426f req-c86e5b74-d96d-4e25-a07a-fc8f300e1c59 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0533211
May 25 16:40:30.298773 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7179edb-025a-4e13-a111-025d8f8b0f75 req-997748b1-241d-4c1f-bd05-a7616802d56d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:30.300627 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c7179edb-025a-4e13-a111-025d8f8b0f75 req-997748b1-241d-4c1f-bd05-a7616802d56d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.0931158
May 25 16:40:30.352874 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c7179edb-025a-4e13-a111-025d8f8b0f75 req-78c8ae48-deda-40d0-ae89-2ee00fa7e71f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0445247
May 25 16:40:30.446195 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device f9f25895-4aec-487b-bcc9-f61318cb3aba details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:40:30.602379 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port f9f25895-4aec-487b-bcc9-f61318cb3aba, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:30.617572 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'port_id': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'mac_address': 'fa:16:3e:50:60:66', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 401, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:40:30.681552 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:30.718273 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f9f25895-4aec-487b-bcc9-f61318cb3aba {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:40:30.743362 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port f9f25895-4aec-487b-bcc9-f61318cb3aba, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:30.748905 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:30.752200 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:30.764388 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee563f8-9214-4668-bb1f-965958a9bc9e req-e9d295fc-10a3-4c75-acea-bc1dce39893a tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:30.766031 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3ee563f8-9214-4668-bb1f-965958a9bc9e req-e9d295fc-10a3-4c75-acea-bc1dce39893a tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.1097157
May 25 16:40:30.828386 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3ee563f8-9214-4668-bb1f-965958a9bc9e req-dbb5ecea-7c5e-4837-8484-d391f8d3a5e3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0558126
May 25 16:40:30.839271 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=f9f25895-4aec-487b-bcc9-f61318cb3aba,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:30.845674 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:30.919017 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13333ba1-509c-4c9a-8ce7-39bf1238352d req-0c1fda6b-8e97-451a-a4d7-e132c9827be1 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:30.921434 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-13333ba1-509c-4c9a-8ce7-39bf1238352d req-0c1fda6b-8e97-451a-a4d7-e132c9827be1 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0902710
May 25 16:40:30.971890 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-13333ba1-509c-4c9a-8ce7-39bf1238352d req-d6b85676-d297-4e46-bd0e-13e148bba6df tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0447931
May 25 16:40:31.031267 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['f9f25895-4aec-487b-bcc9-f61318cb3aba'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:40:31.230499 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 55772) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:31.294663 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_v2 [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Deleting subnet 4030a70d-20ce-4ddd-ab1c-d1d794468e8e {{(pid=92013) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:40:31.297743 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:31.347528 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6928876'] for subnet, precommit_delete_associations {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:31.406315 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-9d3de119-f527-4234-949b-f346004be42b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:31.412791 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:31.703040 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f671d57-0e05-4209-87ff-c45c663cc828 req-ffc559ba-dac7-4020-9a2d-6b02e998c03f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:31.705247 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1f671d57-0e05-4209-87ff-c45c663cc828 req-ffc559ba-dac7-4020-9a2d-6b02e998c03f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.2267101
May 25 16:40:31.777490 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6928756', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7156487'] for subnet, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:31.780855 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1f671d57-0e05-4209-87ff-c45c663cc828 req-c5ea4eaa-d212-4a35-9dfc-e18ae3af3855 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0592573
May 25 16:40:31.784433 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:31.817126 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4030a70d-20ce-4ddd-ab1c-d1d794468e8e,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:31.824649 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Notify callbacks [] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:31.831485 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:31.831842 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:31.832215 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:31.832555 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:31.832889 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:31.833223 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:31.833581 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:31.834435 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:31.834774 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:31.835102 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:31.835430 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:31.835754 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:31.839088 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:31.841907 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-db8e37a2-5688-4c20-8d9a-6425b77f33db admin admin] 10.222.0.73 "DELETE /v2.0/subnets/4030a70d-20ce-4ddd-ab1c-d1d794468e8e HTTP/1.1" status: 204  len: 168 time: 0.6102309
May 25 16:40:31.844460 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 55778) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:31.995223 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:32.185626 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-191c3c22-a69f-420e-8854-b51cd7471b45 req-b5d64860-dc1d-4ee8-8d27-d6cffcee9914 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:32.187104 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-191c3c22-a69f-420e-8854-b51cd7471b45 req-b5d64860-dc1d-4ee8-8d27-d6cffcee9914 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 944 time: 0.2543027
May 25 16:40:32.201914 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:32.236989 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346a03a9a0>,) {'filters': {'network_id': ['5782c094-7ba9-4a97-a5bd-3f5f0a0557b0']}} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:32.263189 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346a03a9a0>, '73d0d26b-c8b0-4163-b874-267f21730cc2') {'for_net_delete': True} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:32.263486 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346a03a9a0>, '73d0d26b-c8b0-4163-b874-267f21730cc2') {} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:32.289894 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6928871'] for segment, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:32.306057 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-191c3c22-a69f-420e-8854-b51cd7471b45 req-4f4b127b-4f49-436a-9904-f1e2d6ba41d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1088083
May 25 16:40:32.317683 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:32.329905 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef698028-76f6-4eb3-b63b-c77e6d0bb780 req-611af524-a080-42f6-b404-3724e5c54963 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:32.331356 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef698028-76f6-4eb3-b63b-c77e6d0bb780 req-611af524-a080-42f6-b404-3724e5c54963 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.2063107
May 25 16:40:32.334598 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] Releasing vlan 440 on physical network physnet1 to pool {{(pid=92013) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:40:32.335064 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7025874'] for segment, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]: Traceback (most recent call last):
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     timer()
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     cb(*args, **kw)
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     return func(*args, **kwargs)
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     self._notify()
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     self.callback(batched_events)
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     event.method(event)
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     return f(self, *a, **k)
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self._get(url).json()
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self.request(url, 'GET', **kwargs)
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:40:32.349065 dv-cinder-786386-6-iscsi neutron-server[92013]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:40:32.445153 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device f9f25895-4aec-487b-bcc9-f61318cb3aba up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:40:32.468368 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef698028-76f6-4eb3-b63b-c77e6d0bb780 req-bdcb3961-b87f-4d36-b849-6c15fd4589b5 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1155787
May 25 16:40:32.474251 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:32.489607 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:32.494131 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:32.546495 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port f9f25895-4aec-487b-bcc9-f61318cb3aba completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:40:32.553337 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port f9f25895-4aec-487b-bcc9-f61318cb3aba triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:40:32.553753 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:32.607120 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] Pushing event deleted for resources: {'Network': ['ID=5782c094-7ba9-4a97-a5bd-3f5f0a0557b0,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:32.610217 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:32.615852 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] 10.222.0.73 "DELETE /v2.0/networks/5782c094-7ba9-4a97-a5bd-3f5f0a0557b0 HTTP/1.1" status: 204  len: 168 time: 0.7697430
May 25 16:40:32.679341 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:32.707979 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:40:32.720502 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port f9f25895-4aec-487b-bcc9-f61318cb3aba, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:32.724364 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:32.727513 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:32.766365 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'code': 200}
May 25 16:40:32.808981 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 55802) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:32.809519 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=f9f25895-4aec-487b-bcc9-f61318cb3aba,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:32.817493 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:32.817858 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:32.818858 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:32.819200 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:32.819520 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:32.819841 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:32.820155 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:32.820468 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:32.820783 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:32.821430 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:32.821430 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:32.821727 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:40:32.825601 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:32.860742 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-be37d9c9-36df-426f-b4d4-c35f2b5a4e02 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=73cf5a2c98e64235b56c6c8b43e872f5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0502284
May 25 16:40:32.863071 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 55808) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:32.926010 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a61e467d-83af-4939-b82b-0702d345dac9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:32.955539 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a61e467d-83af-4939-b82b-0702d345dac9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:32.988610 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9caf3ffc-597d-4f03-bc85-441ab2e93264 req-34237fff-9239-416f-8bd9-234547c3d70e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:32.990861 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9caf3ffc-597d-4f03-bc85-441ab2e93264 req-34237fff-9239-416f-8bd9-234547c3d70e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.0900135
May 25 16:40:33.038495 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9caf3ffc-597d-4f03-bc85-441ab2e93264 req-39273286-85c9-43a2-a629-7719dff14e18 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418954
May 25 16:40:33.056885 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a61e467d-83af-4939-b82b-0702d345dac9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:33.062040 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-007cfbea-1209-486f-8d56-36fc25928345 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:33.077441 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a61e467d-83af-4939-b82b-0702d345dac9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37f99fe6-9311-4629-b99b-d75270870d12,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:33.081211 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a61e467d-83af-4939-b82b-0702d345dac9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:33.090274 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a61e467d-83af-4939-b82b-0702d345dac9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:33.091373 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-a61e467d-83af-4939-b82b-0702d345dac9 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/37f99fe6-9311-4629-b99b-d75270870d12 HTTP/1.1" status: 204  len: 168 time: 0.2272611
May 25 16:40:33.104952 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ab35ac4-9636-4cc5-a137-0eb3030d4150 req-9c8ae20b-ecfa-464e-9ed6-23fb5f1c211e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:33.106651 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-2ab35ac4-9636-4cc5-a137-0eb3030d4150 req-9c8ae20b-ecfa-464e-9ed6-23fb5f1c211e service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 1098 time: 0.1060255
May 25 16:40:33.152055 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-2ab35ac4-9636-4cc5-a137-0eb3030d4150 req-ed4c3edf-ee16-4456-843a-0e5969695d99 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0363445
May 25 16:40:33.500973 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2349d5f8-ea6c-465b-9c2c-5b87316b6e2a req-75aa9690-bfd4-4b7a-a7e9-f5b231ebe6a4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:33.502508 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2349d5f8-ea6c-465b-9c2c-5b87316b6e2a req-75aa9690-bfd4-4b7a-a7e9-f5b231ebe6a4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.0889428
May 25 16:40:33.550905 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2349d5f8-ea6c-465b-9c2c-5b87316b6e2a req-44e46508-d3cc-4b96-8277-b52563d9a888 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0417399
May 25 16:40:33.713686 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c021d84-7989-467f-96e6-cd1986613375 req-28acbad0-98c2-4569-978c-a8d164231c7a tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:33.715224 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1c021d84-7989-467f-96e6-cd1986613375 req-28acbad0-98c2-4569-978c-a8d164231c7a tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1112592
May 25 16:40:33.765717 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1c021d84-7989-467f-96e6-cd1986613375 req-c72f64b4-ee02-4af1-8f8e-87495d206878 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0445559
May 25 16:40:33.844011 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:34.118762 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-77f1273f-b011-4697-ac7d-4cd1b4f956b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:34.249294 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b51933c-64c6-4091-a8f3-e98f81c22ff8 req-0aff2ad9-74eb-4514-a6fc-da67e0f01027 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:34.250955 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3b51933c-64c6-4091-a8f3-e98f81c22ff8 req-0aff2ad9-74eb-4514-a6fc-da67e0f01027 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.0829668
May 25 16:40:34.298866 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3b51933c-64c6-4091-a8f3-e98f81c22ff8 req-282a3359-d2b8-4444-bdaf-f8a333e799f1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0417857
May 25 16:40:34.345804 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 55856) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:34.498249 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3d8d44c0-74c4-4bcc-8d82-1dbff4c20141 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:34.512099 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-3d8d44c0-74c4-4bcc-8d82-1dbff4c20141 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:40:34.516343 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-3d8d44c0-74c4-4bcc-8d82-1dbff4c20141 admin admin] Usage tracker for resource:security_group_rule and tenant:6935218553044708b5f45adb4db71ad6 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:40:34.519136 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-3d8d44c0-74c4-4bcc-8d82-1dbff4c20141 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:40:34.524688 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-3d8d44c0-74c4-4bcc-8d82-1dbff4c20141 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:40:34.613042 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3d8d44c0-74c4-4bcc-8d82-1dbff4c20141 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:34.618249 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3d8d44c0-74c4-4bcc-8d82-1dbff4c20141 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:34.625365 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c4f1573d-16cd-420a-ae34-a431fbde04a8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:34.668862 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-3d8d44c0-74c4-4bcc-8d82-1dbff4c20141 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=6935218553044708b5f45adb4db71ad6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3217053
May 25 16:40:34.669517 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d8d44c0-74c4-4bcc-8d82-1dbff4c20141 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2ed8406a-b935-4a85-a227-b5e3b492091d,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:34.671821 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 55864) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:34.674158 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3d8d44c0-74c4-4bcc-8d82-1dbff4c20141 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:34.736340 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-dd4d0fd4-ed6a-49bf-a5a0-611039ef3a5c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:34.763981 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-dd4d0fd4-ed6a-49bf-a5a0-611039ef3a5c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:34.768177 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-481655cc-1b28-42ec-8f89-3a6313e7b8d8 req-947814e0-b3ed-4681-8a80-78b6ba0f9b98 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:34.769681 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-481655cc-1b28-42ec-8f89-3a6313e7b8d8 req-947814e0-b3ed-4681-8a80-78b6ba0f9b98 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.1015100
May 25 16:40:34.820353 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-dd4d0fd4-ed6a-49bf-a5a0-611039ef3a5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:34.821888 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-481655cc-1b28-42ec-8f89-3a6313e7b8d8 req-ba524883-a2c4-4101-ab99-c11e6d1d2480 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0459127
May 25 16:40:34.824123 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0b934cfc-90f9-4d33-930d-09731e96ce66 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:34.836416 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd4d0fd4-ed6a-49bf-a5a0-611039ef3a5c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ed8406a-b935-4a85-a227-b5e3b492091d,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:34.843633 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-dd4d0fd4-ed6a-49bf-a5a0-611039ef3a5c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:34.846980 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-dd4d0fd4-ed6a-49bf-a5a0-611039ef3a5c admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/2ed8406a-b935-4a85-a227-b5e3b492091d HTTP/1.1" status: 204  len: 168 time: 0.1720293
May 25 16:40:34.846980 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-dd4d0fd4-ed6a-49bf-a5a0-611039ef3a5c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:34.975197 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a44768-e12c-4b85-a226-896ffc6ce0dc req-81b4795f-ead4-4af4-a76a-a83e3f06ee19 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:34.976700 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-75a44768-e12c-4b85-a226-896ffc6ce0dc req-81b4795f-ead4-4af4-a76a-a83e3f06ee19 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0927410
May 25 16:40:35.044442 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:35.073677 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-75a44768-e12c-4b85-a226-896ffc6ce0dc req-1c9b7569-e410-44fd-8287-d28942e66855 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0601420
May 25 16:40:35.107830 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-882ca283-c506-4f57-b685-3ece93d36149 req-7adfdd7d-702c-48da-a4c2-043be3612a77 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:35.111510 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-882ca283-c506-4f57-b685-3ece93d36149 req-7adfdd7d-702c-48da-a4c2-043be3612a77 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.1317904
May 25 16:40:35.156373 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-882ca283-c506-4f57-b685-3ece93d36149 req-68cd94be-1af2-4acc-876b-62df750474fd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404522
May 25 16:40:35.179831 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 55884) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:35.551940 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc003cb9-325f-42b0-bc9b-386959c7e00b tempest-TestShelveInstance-57932950 tempest-TestShelveInstance-57932950-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:35.553173 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-dc003cb9-325f-42b0-bc9b-386959c7e00b tempest-TestShelveInstance-57932950 tempest-TestShelveInstance-57932950-project-admin] Synchronizing usage tracker for tenant:3aa35a088d0242458aafe4c1b207fec3 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:40:35.565107 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d188d79-97de-4362-8a3f-086e2b97ec24 req-9c8bd889-da37-4d4f-b3cb-f6aeec4a8418 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:35.566639 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d188d79-97de-4362-8a3f-086e2b97ec24 req-9c8bd889-da37-4d4f-b3cb-f6aeec4a8418 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1141505
May 25 16:40:35.598259 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-dc003cb9-325f-42b0-bc9b-386959c7e00b tempest-TestShelveInstance-57932950 tempest-TestShelveInstance-57932950-project-admin] Unset dirty status for tenant:3aa35a088d0242458aafe4c1b207fec3 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:40:35.599401 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-dc003cb9-325f-42b0-bc9b-386959c7e00b tempest-TestShelveInstance-57932950 tempest-TestShelveInstance-57932950-project-admin] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 1093 time: 0.4180450
May 25 16:40:35.602482 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 55902) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:35.607709 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Request body: {'floatingip': {'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'port_id': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'fixed_ip_address': '172.20.0.8'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:40:35.615668 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:40:35.621868 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Usage tracker for resource:floatingip and tenant:a723bbfba23f463dbb8da0bdacb4b0aa is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:40:35.624084 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d188d79-97de-4362-8a3f-086e2b97ec24 req-52535689-56ff-48eb-941e-a45fa4fdcf3e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0434232
May 25 16:40:35.624738 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:40:35.632030 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:40:35.653551 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for floatingip, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:35.801464 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:35.943671 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Allocated IP 172.27.3.131 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/76ff0ea7-d6c2-44d0-b079-eeede54cafe7) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:40:36.112292 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:36.145576 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:36.154262 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:36.239143 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:40:36.242740 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:40:36.246127 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:40:36.279967 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Pushing event updated for resources: {'Port': ['ID=76ff0ea7-d6c2-44d0-b079-eeede54cafe7,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:36.284168 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:36.288898 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaa96c70-ddda-463c-b579-27e5053770ce req-aa07bfcd-bd19-4cd5-9765-47ec4edf6f7b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:36.294031 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eaa96c70-ddda-463c-b579-27e5053770ce req-aa07bfcd-bd19-4cd5-9765-47ec4edf6f7b tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.0915072
May 25 16:40:36.339359 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eaa96c70-ddda-463c-b579-27e5053770ce req-9a3550ba-455e-4885-8ab3-411cc74c61bf tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425014
May 25 16:40:36.551123 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:36.753921 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:36.816456 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01489f0c-a9cc-467c-9418-da8f391707c3 req-097207a8-3238-487e-9ec5-d4215a82ff37 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:36.817834 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-01489f0c-a9cc-467c-9418-da8f391707c3 req-097207a8-3238-487e-9ec5-d4215a82ff37 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.0807536
May 25 16:40:36.830336 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:36.864734 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-01489f0c-a9cc-467c-9418-da8f391707c3 req-27381ad0-df1a-4d0c-8400-a57de2ca8de6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0410357
May 25 16:40:37.033671 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:37.039205 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:37.042877 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0bebbabe-c881-4ddf-9881-6c221cfa593f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:37.166319 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Pushing event updated for resources: {'Port': ['ID=76ff0ea7-d6c2-44d0-b079-eeede54cafe7,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:37.170531 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:37.175011 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:37.354867 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.l3_db [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Floating IP 0ad56454-abdb-48cc-8ff9-bb851ef5c302 associated. External IP: 172.27.3.131, port: f9f25895-4aec-487b-bcc9-f61318cb3aba.
May 25 16:40:37.579948 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b21061df-1f33-4bb6-9b08-3db9d7ae1942 req-647069ff-63f6-4fe5-8455-bda14f233242 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:37.581771 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b21061df-1f33-4bb6-9b08-3db9d7ae1942 req-647069ff-63f6-4fe5-8455-bda14f233242 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1081092
May 25 16:40:37.635848 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b21061df-1f33-4bb6-9b08-3db9d7ae1942 req-52eed69e-97a2-40eb-9d46-1912e1ec6f4e tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0479407
May 25 16:40:37.769292 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Router d9f2f836-a3d4-438f-9259-98d8faf7dddd has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:40:38.068312 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f998983f-b9a8-4bfa-ae93-309f88cace44 req-abd2790e-898f-45b2-ab7a-ddaade0958dc tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:38.069806 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f998983f-b9a8-4bfa-ae93-309f88cace44 req-abd2790e-898f-45b2-ab7a-ddaade0958dc tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.0880291
May 25 16:40:38.086820 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:40:38.101121 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-880de267-3fd2-48ef-894f-6be3e5b41cfe None None] Sync routers for ids ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:40:38.114499 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-880de267-3fd2-48ef-894f-6be3e5b41cfe None None] Routers {'d9f2f836-a3d4-438f-9259-98d8faf7dddd'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:40:38.115187 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-880de267-3fd2-48ef-894f-6be3e5b41cfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b97b9d0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:40:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:38.119576 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f998983f-b9a8-4bfa-ae93-309f88cace44 req-22454a67-0f3a-4dd9-b986-b942ce69af17 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435090
May 25 16:40:38.133641 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:38.213924 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.5987694
May 25 16:40:38.213924 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:40:38.248111 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'status': 'completed', 'code': 200}
May 25 16:40:38.308871 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-880de267-3fd2-48ef-894f-6be3e5b41cfe None None] Set router d9f2f836-a3d4-438f-9259-98d8faf7dddd gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:40:38.383085 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-435ccba7-4d2c-4621-83d3-3985ba865872 req-b4caf058-614c-4548-8d42-259feff5f4d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:38.384701 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-435ccba7-4d2c-4621-83d3-3985ba865872 req-b4caf058-614c-4548-8d42-259feff5f4d0 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a723bbfba23f463dbb8da0bdacb4b0aa&device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 1098 time: 0.1075606
May 25 16:40:38.563434 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-435ccba7-4d2c-4621-83d3-3985ba865872 req-ac2b96af-fc61-41b4-b6ca-0eea1ef2c53c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:38.565055 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-435ccba7-4d2c-4621-83d3-3985ba865872 req-ac2b96af-fc61-41b4-b6ca-0eea1ef2c53c service neutron] 10.222.0.76 "GET /v2.0/networks?id=3e40698a-e2cb-4812-9711-e3b481dbc8b3 HTTP/1.1" status: 200  len: 910 time: 0.1717706
May 25 16:40:38.585465 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-b86da4eb-4957-49ce-9503-96121bbf18b8 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/networks?tenant_id=24825da1d862442b81b3c8836f431b59&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0366993
May 25 16:40:38.710090 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-880de267-3fd2-48ef-894f-6be3e5b41cfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b97b9d0>, [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:39:37Z', 'revision_number': 4, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port': {'id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:a9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:32Z', 'updated_at': '2021-05-25T16:39:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '0ad56454-abdb-48cc-8ff9-bb851ef5c302', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'floating_ip_address': '172.27.3.131', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'port_id': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 407, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'mac_address': 'fa:16:3e:50:60:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '550a76ba-233b-4d54-8223-01267bd33511', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:40:36Z', 'updated_at': '2021-05-25T16:40:36Z', 'revision_number': 0, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd', 'name': '', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'mac_address': 'fa:16:3e:5a:26:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_interface', 'standard_attr_id': 377, 'fixed_ips': [{'subnet_id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:36Z', 'updated_at': '2021-05-25T16:39:45Z', 'revision_number': 5, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'subnets': [{'id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:38.716142 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-880de267-3fd2-48ef-894f-6be3e5b41cfe None None] Checking router: d9f2f836-a3d4-438f-9259-98d8faf7dddd for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:40:38.727506 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-880de267-3fd2-48ef-894f-6be3e5b41cfe None None] Routers {'d9f2f836-a3d4-438f-9259-98d8faf7dddd'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:40:38.728380 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-880de267-3fd2-48ef-894f-6be3e5b41cfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b97b9d0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:40:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:38.746857 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-435ccba7-4d2c-4621-83d3-3985ba865872 req-b51343f0-dd45-4046-b0a3-5d35fa99fdb0 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba HTTP/1.1" status: 200  len: 999 time: 0.1692035
May 25 16:40:38.749648 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-bbb66298-4978-4849-8f61-d30e736baf31 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:38.758389 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-bbb66298-4978-4849-8f61-d30e736baf31 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1720719
May 25 16:40:38.774697 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-c20f44fb-2a09-4562-a4c1-be5a35e2e7de tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/quotas/24825da1d862442b81b3c8836f431b59 HTTP/1.1" status: 200  len: 375 time: 0.0154212
May 25 16:40:38.826777 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-6912490e-09c4-4245-a727-8d0746068690 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=24825da1d862442b81b3c8836f431b59&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0511656
May 25 16:40:38.868709 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-435ccba7-4d2c-4621-83d3-3985ba865872 req-bb1fafa8-3267-49cd-ac32-bb0dd9d6c4f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:38.870858 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-435ccba7-4d2c-4621-83d3-3985ba865872 req-bb1fafa8-3267-49cd-ac32-bb0dd9d6c4f3 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=6203ecab-ef7b-4872-ac7a-33ea4cfae323 HTTP/1.1" status: 200  len: 848 time: 0.1161900
May 25 16:40:38.962907 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868e4b1d-f9c4-47e0-b164-20567f2c3671 req-e41f563f-8f23-433f-b00d-a584315542c8 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:38.964633 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-868e4b1d-f9c4-47e0-b164-20567f2c3671 req-e41f563f-8f23-433f-b00d-a584315542c8 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1222892
May 25 16:40:39.030934 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-880de267-3fd2-48ef-894f-6be3e5b41cfe None None] Set router d9f2f836-a3d4-438f-9259-98d8faf7dddd gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:40:39.035319 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-435ccba7-4d2c-4621-83d3-3985ba865872 req-c787696d-1bd7-495d-aa9c-a0f1777c84fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:39.042612 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-435ccba7-4d2c-4621-83d3-3985ba865872 req-c787696d-1bd7-495d-aa9c-a0f1777c84fd service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=3e40698a-e2cb-4812-9711-e3b481dbc8b3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1574667
May 25 16:40:39.066981 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-868e4b1d-f9c4-47e0-b164-20567f2c3671 req-bdb050c9-06a7-4e92-8d63-816d2d93f3f0 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0945427
May 25 16:40:39.150234 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f816d9fe-b58d-4a15-8161-3c262975e4c6 req-f6ffb647-1bec-487f-a6ff-82f66f061f06 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 210 time: 0.0978706
May 25 16:40:39.257387 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-435ccba7-4d2c-4621-83d3-3985ba865872 req-22154c9f-3480-46b0-9eab-ae61a1589783 service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2126198
May 25 16:40:39.406787 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab6fbad-b6a1-4fe0-af51-290c1a1df6d1 req-020077c3-771b-4179-b0db-f2dd84812ece tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:39.408018 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5ab6fbad-b6a1-4fe0-af51-290c1a1df6d1 req-020077c3-771b-4179-b0db-f2dd84812ece tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1371644
May 25 16:40:39.447756 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-435ccba7-4d2c-4621-83d3-3985ba865872 req-06459b63-3100-4fa1-917a-08c9270561c4 service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1771774
May 25 16:40:39.514009 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-880de267-3fd2-48ef-894f-6be3e5b41cfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b97b9d0>, [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:39:37Z', 'revision_number': 4, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port': {'id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:a9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:32Z', 'updated_at': '2021-05-25T16:39:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '0ad56454-abdb-48cc-8ff9-bb851ef5c302', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'floating_ip_address': '172.27.3.131', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'port_id': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 407, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'mac_address': 'fa:16:3e:50:60:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '550a76ba-233b-4d54-8223-01267bd33511', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:40:36Z', 'updated_at': '2021-05-25T16:40:36Z', 'revision_number': 0, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd', 'name': '', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'mac_address': 'fa:16:3e:5a:26:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_interface', 'standard_attr_id': 377, 'fixed_ips': [{'subnet_id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:36Z', 'updated_at': '2021-05-25T16:39:45Z', 'revision_number': 5, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'subnets': [{'id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:39.518835 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-880de267-3fd2-48ef-894f-6be3e5b41cfe None None] The sync data for ids ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'] in dv-cinder-786386-6-iscsi is: [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:39:37Z', 'revision_number': 4, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port': {'id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:a9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:32Z', 'updated_at': '2021-05-25T16:39:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '0ad56454-abdb-48cc-8ff9-bb851ef5c302', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'floating_ip_address': '172.27.3.131', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'port_id': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 407, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'mac_address': 'fa:16:3e:50:60:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '550a76ba-233b-4d54-8223-01267bd33511', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:40:36Z', 'updated_at': '2021-05-25T16:40:36Z', 'revision_number': 0, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd', 'name': '', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'mac_address': 'fa:16:3e:5a:26:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_interface', 'standard_attr_id': 377, 'fixed_ips': [{'subnet_id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:36Z', 'updated_at': '2021-05-25T16:39:45Z', 'revision_number': 5, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'subnets': [{'id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:40:39.550070 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5ab6fbad-b6a1-4fe0-af51-290c1a1df6d1 req-ef6b4f70-8228-4465-b63c-a8fa7e2ecdca tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1348948
May 25 16:40:39.788105 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bf22093-4ac0-4046-b4b7-521969f51ccb None None] New status for floating IP 0ad56454-abdb-48cc-8ff9-bb851ef5c302: ACTIVE {{(pid=92014) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:40:39.804827 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-44fef68a-ea05-4de4-b2c8-f9ccb45ae019 req-804d0e3e-3cc8-4b40-a7d1-0a8b3e3f0b16 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0731936
May 25 16:40:39.910369 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44fef68a-ea05-4de4-b2c8-f9ccb45ae019 req-d90c926c-e43f-457b-919c-5ff7d14219ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:39.910739 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1293d6bd-d834-429a-ad91-906e95f4c963 req-e6e2491d-f545-4c97-88af-8b7726ed99dd tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:39.911518 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-1293d6bd-d834-429a-ad91-906e95f4c963 req-e6e2491d-f545-4c97-88af-8b7726ed99dd tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Synchronizing usage tracker for tenant:fe57668427364ea7acb08a0f7f2826ed on resource:port {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:40:39.912010 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-44fef68a-ea05-4de4-b2c8-f9ccb45ae019 req-d90c926c-e43f-457b-919c-5ff7d14219ec service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=63f896ab0d7e44158204551033c33ba4&device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 1098 time: 0.0767541
May 25 16:40:39.930825 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [req-1293d6bd-d834-429a-ad91-906e95f4c963 req-e6e2491d-f545-4c97-88af-8b7726ed99dd tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Unset dirty status for tenant:fe57668427364ea7acb08a0f7f2826ed on resource:port {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:40:39.932651 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-1293d6bd-d834-429a-ad91-906e95f4c963 req-e6e2491d-f545-4c97-88af-8b7726ed99dd tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.76 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.1089458
May 25 16:40:40.089825 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-1293d6bd-d834-429a-ad91-906e95f4c963 req-e4a89943-ed25-4674-8a0a-d56fd64a33d6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Deleting port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:40:40.090477 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-1293d6bd-d834-429a-ad91-906e95f4c963 req-e4a89943-ed25-4674-8a0a-d56fd64a33d6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:40.104755 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44fef68a-ea05-4de4-b2c8-f9ccb45ae019 req-aef6826f-b279-47c0-b921-5715f24d748f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:40.106578 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-44fef68a-ea05-4de4-b2c8-f9ccb45ae019 req-aef6826f-b279-47c0-b921-5715f24d748f service neutron] 10.222.0.76 "GET /v2.0/networks?id=ce683266-622a-4b13-a610-301441bf2882 HTTP/1.1" status: 200  len: 912 time: 0.1727860
May 25 16:40:40.270711 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [req-1293d6bd-d834-429a-ad91-906e95f4c963 req-e4a89943-ed25-4674-8a0a-d56fd64a33d6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] For port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d,segment=NetworkSegment(227f55be-6fbd-4206-b845-6ee4d0737571),segment_id=227f55be-6fbd-4206-b845-6ee4d0737571)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:40.271940 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-1293d6bd-d834-429a-ad91-906e95f4c963 req-e4a89943-ed25-4674-8a0a-d56fd64a33d6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:40.322851 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-44fef68a-ea05-4de4-b2c8-f9ccb45ae019 req-4d2dc593-dccb-4a39-902f-3cb567155e2f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2b1a8c74-03d6-4f98-a405-94fc04b50dd4 HTTP/1.1" status: 200  len: 1001 time: 0.2045553
May 25 16:40:40.371893 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-df0d8a28-0803-4b25-beaa-a8a051971d49 req-5dda6f86-0010-4588-9999-35ea1a16dc4a tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 210 time: 0.0915723
May 25 16:40:40.412287 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [req-1293d6bd-d834-429a-ad91-906e95f4c963 req-e4a89943-ed25-4674-8a0a-d56fd64a33d6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Calling delete_port for ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d owned by compute:nova {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:40:40.427156 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44fef68a-ea05-4de4-b2c8-f9ccb45ae019 req-0cda600c-f257-4b1a-983f-0f4ea96b54ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:40.428696 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-44fef68a-ea05-4de4-b2c8-f9ccb45ae019 req-0cda600c-f257-4b1a-983f-0f4ea96b54ed service neutron] 10.222.0.76 "GET /v2.0/subnets?id=06161ba6-62a3-443f-9cfb-bccf3f60ad9c HTTP/1.1" status: 200  len: 850 time: 0.0897248
May 25 16:40:40.441086 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b988b85-50db-4ff5-b36d-084f232ca761 req-e78deb3d-6265-4b7c-a5a8-c1539a05a339 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:40.448392 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6b988b85-50db-4ff5-b36d-084f232ca761 req-e78deb3d-6265-4b7c-a5a8-c1539a05a339 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/ports?device_id=9f035b9c-0d0a-439e-80aa-646a77153848 HTTP/1.1" status: 200  len: 946 time: 0.2242107
May 25 16:40:40.543044 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-1293d6bd-d834-429a-ad91-906e95f4c963 req-e4a89943-ed25-4674-8a0a-d56fd64a33d6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:40.551406 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:40.561423 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6b988b85-50db-4ff5-b36d-084f232ca761 req-111d8a12-9a7c-4be7-9906-56cf3166339e tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.73 "GET /v2.0/security-groups?id=65702db5-e301-4057-a8d9-21523ce3a5da&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1120760
May 25 16:40:40.575539 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44fef68a-ea05-4de4-b2c8-f9ccb45ae019 req-427dda83-9387-4581-ba1d-86020922aaca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:40.576979 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-44fef68a-ea05-4de4-b2c8-f9ccb45ae019 req-427dda83-9387-4581-ba1d-86020922aaca service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ce683266-622a-4b13-a610-301441bf2882&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1261663
May 25 16:40:40.786008 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a89943-ed25-4674-8a0a-d56fd64a33d6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Pushing event deleted for resources: {'Port': ['ID=ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:40.788438 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-e4a89943-ed25-4674-8a0a-d56fd64a33d6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:40.847326 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [req-1293d6bd-d834-429a-ad91-906e95f4c963 req-e4a89943-ed25-4674-8a0a-d56fd64a33d6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] No DVR routers for this DVR port ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d on host hv-cinder-78638 {{(pid=92012) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:40:40.850598 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [req-1293d6bd-d834-429a-ad91-906e95f4c963 req-e4a89943-ed25-4674-8a0a-d56fd64a33d6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:40.852970 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-842c7a2a-21ae-4720-99d0-3ddaa7c95a14 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=24825da1d862442b81b3c8836f431b59&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0719638
May 25 16:40:40.854460 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f035b9c-0d0a-439e-80aa-646a77153848', 'name': 'network-vif-deleted', 'tag': 'ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:40:40.876037 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-1293d6bd-d834-429a-ad91-906e95f4c963 req-e4a89943-ed25-4674-8a0a-d56fd64a33d6 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] 10.222.0.76 "DELETE /v2.0/ports/ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d HTTP/1.1" status: 204  len: 173 time: 0.9365361
May 25 16:40:40.913737 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9f035b9c-0d0a-439e-80aa-646a77153848', 'name': 'network-vif-deleted', 'tag': 'ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d', 'status': 'completed', 'code': 200}
May 25 16:40:40.994437 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-44fef68a-ea05-4de4-b2c8-f9ccb45ae019 req-57c9977b-8e1c-4ada-8443-8d42644eafc3 service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4037287
May 25 16:40:41.007976 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57ce9f27-c702-4be1-9ec1-6225f6fd41e4 req-a3deea14-3307-4fac-a2eb-0cf388942f07 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:41.013481 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-57ce9f27-c702-4be1-9ec1-6225f6fd41e4 req-a3deea14-3307-4fac-a2eb-0cf388942f07 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.2932472
May 25 16:40:41.217384 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-57ce9f27-c702-4be1-9ec1-6225f6fd41e4 req-99088ae5-36e2-4ca2-9b57-ecfedfbc27ee tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1854784
May 25 16:40:41.262750 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-5f448920-cf62-4271-8500-18b80de6c4cc tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:41.264287 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-5f448920-cf62-4271-8500-18b80de6c4cc tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.3925934
May 25 16:40:41.273558 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-44fef68a-ea05-4de4-b2c8-f9ccb45ae019 req-bbfa9151-0eb3-444f-8e86-7e4a20a5cd4f service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2427602
May 25 16:40:41.293476 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Request body: {'port': {'device_id': 'b324d3c0-cab5-450f-836c-0a8be9eebe3e', 'network_id': '1235741b-b9bd-40c7-a0a4-63bc412a6700', 'admin_state_up': True, 'tenant_id': '24825da1d862442b81b3c8836f431b59'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:40:41.437025 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:40:41.441037 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Usage tracker for resource:port and tenant:24825da1d862442b81b3c8836f431b59 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:40:41.445167 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:40:41.451571 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:40:41.465364 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Made reservation on behalf of 24825da1d862442b81b3c8836f431b59 for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:40:41.468003 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:41.486242 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:41.502622 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:40:41.508177 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Usage tracker for resource:security_group_rule and tenant:24825da1d862442b81b3c8836f431b59 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:40:41.539989 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:40:41.557439 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:40:41.561565 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-27992e76-ccb7-4d36-a93e-d51ef3a78f6c req-818ff878-74e8-4408-8cc4-f51156000b1f tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 210 time: 0.0550475
May 25 16:40:41.668317 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:41.675181 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:41.678129 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:41.687308 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56018) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:41.755493 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Pushing event updated for resources: {'SecurityGroup': ['ID=15d6eaab-0e64-4634-b6b7-08f52c8b7bc4,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:41.764935 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:41.949159 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Allocated IP 192.168.233.94 (1235741b-b9bd-40c7-a0a4-63bc412a6700/3c2b6433-203d-442f-b9b1-64f968f23228/75c8b59d-a367-490d-8805-67d51d1d66e4) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:40:42.161834 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:42.181563 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Transition to ACTIVE for port object 75c8b59d-a367-490d-8805-67d51d1d66e4 will not be triggered until provisioned by entity DHCP. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:40:42.216255 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:42.222419 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:42.309634 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Network 1235741b-b9bd-40c7-a0a4-63bc412a6700 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:40:42.313492 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:40:42.319185 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:40:42.336178 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-501288'] for router_interface, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:42.352332 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Pushing event updated for resources: {'Port': ['ID=75c8b59d-a367-490d-8805-67d51d1d66e4,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:42.368215 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:42.412886 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:42.413534 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:42.452294 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 937 time: 1.1624584
May 25 16:40:42.472025 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Request body: {'port': {'device_id': 'b324d3c0-cab5-450f-836c-0a8be9eebe3e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:40:42.493002 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:40:42.603002 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:40:42.603348 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device ab6bfbbb-95e6-4aa7-960f-b4f2b6b1655d not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:40:42.706891 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-6b04e6fb-6110-4790-be6c-a7a4a37d86e6 None None] Provisioning for port 75c8b59d-a367-490d-8805-67d51d1d66e4 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:40:42.715830 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-6b04e6fb-6110-4790-be6c-a7a4a37d86e6 None None] Provisioning complete for port 75c8b59d-a367-490d-8805-67d51d1d66e4 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:40:42.716201 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-6b04e6fb-6110-4790-be6c-a7a4a37d86e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:42.771592 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:42.789133 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e998a858-5d15-4a10-98ee-7a86cd6e11aa req-0d1294e9-8f8b-406a-9435-141d5baa5cfa tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:42.789878 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-6b04e6fb-6110-4790-be6c-a7a4a37d86e6 None None] Port 75c8b59d-a367-490d-8805-67d51d1d66e4 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:40:42.790602 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e998a858-5d15-4a10-98ee-7a86cd6e11aa req-0d1294e9-8f8b-406a-9435-141d5baa5cfa tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.2703950
May 25 16:40:42.907764 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e998a858-5d15-4a10-98ee-7a86cd6e11aa req-1785a08b-d79d-45fc-b7d7-776a98a0e43c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1029007
May 25 16:40:42.919239 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] Deleting port f766da42-735a-4b61-b332-9e92e16398ce {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:40:42.919701 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:42.966538 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac6bdb8f-afd9-460d-a83e-5e09d066db61 req-cf4a69fe-ee72-4455-82f2-b68a30021209 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:42.967237 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-ac6bdb8f-afd9-460d-a83e-5e09d066db61 req-cf4a69fe-ee72-4455-82f2-b68a30021209 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Synchronizing usage tracker for tenant:24825da1d862442b81b3c8836f431b59 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:40:43.025593 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-ac6bdb8f-afd9-460d-a83e-5e09d066db61 req-cf4a69fe-ee72-4455-82f2-b68a30021209 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Unset dirty status for tenant:24825da1d862442b81b3c8836f431b59 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:40:43.026832 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ac6bdb8f-afd9-460d-a83e-5e09d066db61 req-cf4a69fe-ee72-4455-82f2-b68a30021209 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 935 time: 0.3176363
May 25 16:40:43.044839 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] For port f766da42-735a-4b61-b332-9e92e16398ce, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=f766da42-735a-4b61-b332-9e92e16398ce,segment=NetworkSegment(227f55be-6fbd-4206-b845-6ee4d0737571),segment_id=227f55be-6fbd-4206-b845-6ee4d0737571)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:43.045196 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:43.148152 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-ac6bdb8f-afd9-460d-a83e-5e09d066db61 req-927c0793-9c49-4dfd-8af1-912bf2b7f78b tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Synchronizing usage tracker for tenant:24825da1d862442b81b3c8836f431b59 on resource:security_group {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:40:43.169739 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] Calling delete_port for f766da42-735a-4b61-b332-9e92e16398ce owned by network:router_interface {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:40:43.187395 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-ac6bdb8f-afd9-460d-a83e-5e09d066db61 req-927c0793-9c49-4dfd-8af1-912bf2b7f78b tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Unset dirty status for tenant:24825da1d862442b81b3c8836f431b59 on resource:security_group {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:40:43.188595 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ac6bdb8f-afd9-460d-a83e-5e09d066db61 req-927c0793-9c49-4dfd-8af1-912bf2b7f78b tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/security-groups?id=15d6eaab-0e64-4634-b6b7-08f52c8b7bc4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1115098
May 25 16:40:43.261227 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 75c8b59d-a367-490d-8805-67d51d1d66e4 {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:40:43.269204 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:43.285056 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Transition to ACTIVE for port object 75c8b59d-a367-490d-8805-67d51d1d66e4 will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:40:43.291551 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:43.295729 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:43.426052 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Pushing event updated for resources: {'Port': ['ID=75c8b59d-a367-490d-8805-67d51d1d66e4,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:43.457439 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:43.540158 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Attempting to bind port 75c8b59d-a367-490d-8805-67d51d1d66e4 on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:40:43.540593 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Attempting to bind port 75c8b59d-a367-490d-8805-67d51d1d66e4 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '1f2c9fdf-ae4e-491a-b3be-e5a8b549664a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 415, 'network_id': '1235741b-b9bd-40c7-a0a4-63bc412a6700'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:40:43.541010 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Attempting to bind port 75c8b59d-a367-490d-8805-67d51d1d66e4 on network 1235741b-b9bd-40c7-a0a4-63bc412a6700 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:40:43.546735 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Port 75c8b59d-a367-490d-8805-67d51d1d66e4 on network 1235741b-b9bd-40c7-a0a4-63bc412a6700 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:40:43.547186 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Attempting to bind port 75c8b59d-a367-490d-8805-67d51d1d66e4 on network 1235741b-b9bd-40c7-a0a4-63bc412a6700 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:40:43.552762 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 40, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:40:43.553471 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Checking segment: {'id': '1f2c9fdf-ae4e-491a-b3be-e5a8b549664a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 415, 'network_id': '1235741b-b9bd-40c7-a0a4-63bc412a6700'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:40:43.554113 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Bound using segment: {'id': '1f2c9fdf-ae4e-491a-b3be-e5a8b549664a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 415, 'network_id': '1235741b-b9bd-40c7-a0a4-63bc412a6700'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:40:43.554843 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Bound port: 75c8b59d-a367-490d-8805-67d51d1d66e4, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1f2c9fdf-ae4e-491a-b3be-e5a8b549664a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 415, 'network_id': '1235741b-b9bd-40c7-a0a4-63bc412a6700'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:40:43.555684 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:43.582722 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:43.587373 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7db6d709-edf7-4c3a-9bd7-036a8b5fc5bc tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:43.636954 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] Pushing event deleted for resources: {'Port': ['ID=f766da42-735a-4b61-b332-9e92e16398ce,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:43.665736 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:43.667740 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] For port 75c8b59d-a367-490d-8805-67d51d1d66e4, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:40:43.672301 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] For port 75c8b59d-a367-490d-8805-67d51d1d66e4, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=75c8b59d-a367-490d-8805-67d51d1d66e4,segment=NetworkSegment(1f2c9fdf-ae4e-491a-b3be-e5a8b549664a),segment_id=1f2c9fdf-ae4e-491a-b3be-e5a8b549664a)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:40:43.676990 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:43.682292 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:43.748019 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:43.748776 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:43.750435 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] 10.222.0.76 "PUT /v2.0/ports/75c8b59d-a367-490d-8805-67d51d1d66e4 HTTP/1.1" status: 200  len: 1097 time: 1.2838140
May 25 16:40:43.751079 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b324d3c0-cab5-450f-836c-0a8be9eebe3e', 'tag': '75c8b59d-a367-490d-8805-67d51d1d66e4'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:40:43.801386 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Pushing event updated for resources: {'Port': ['ID=75c8b59d-a367-490d-8805-67d51d1d66e4,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:43.806767 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:43.823191 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b324d3c0-cab5-450f-836c-0a8be9eebe3e', 'tag': '75c8b59d-a367-490d-8805-67d51d1d66e4', 'status': 'completed', 'code': 200}
May 25 16:40:43.946717 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ec2d51c1-aebe-4016-8fa0-15117972b2f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:43.948624 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-ec2d51c1-aebe-4016-8fa0-15117972b2f1 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=24825da1d862442b81b3c8836f431b59&device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 1100 time: 0.1150882
May 25 16:40:43.981079 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1636838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-506040'] for router_interface, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:44.070016 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:44.134015 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-e20a85f0-5dd2-44ad-840f-efa29188320c service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.94&port_id=75c8b59d-a367-490d-8805-67d51d1d66e4 HTTP/1.1" status: 200  len: 217 time: 0.1760378
May 25 16:40:44.256974 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-0a98554f-99f9-44ec-bb1f-f8cd5dd5eaa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:44.258546 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-0a98554f-99f9-44ec-bb1f-f8cd5dd5eaa3 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3c2b6433-203d-442f-b9b1-64f968f23228 HTTP/1.1" status: 200  len: 843 time: 0.0942919
May 25 16:40:44.361834 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96d39a2-0b02-486f-8051-45adf8edddb5 req-003e157d-9abe-4cfa-895e-530f5b85727f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:44.363292 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d96d39a2-0b02-486f-8051-45adf8edddb5 req-003e157d-9abe-4cfa-895e-530f5b85727f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.2318509
May 25 16:40:44.407103 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] Router 103a2116-9bde-4af3-9e28-4c356cf4c6f7 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:40:44.448067 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d96d39a2-0b02-486f-8051-45adf8edddb5 req-327a0b10-3404-4f65-a83a-c2add956e1cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0685232
May 25 16:40:44.463841 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-e3d91314-2759-4c63-aa48-7428169e487d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:44.465285 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-e3d91314-2759-4c63-aa48-7428169e487d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=1235741b-b9bd-40c7-a0a4-63bc412a6700&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.1970503
May 25 16:40:44.509249 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aa112b4-3f9e-4844-b2d3-9392f69bd6ee req-f597abde-0079-40b3-bd33-8e5ed72bac8d tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:44.510710 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8aa112b4-3f9e-4844-b2d3-9392f69bd6ee req-f597abde-0079-40b3-bd33-8e5ed72bac8d tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 947 time: 0.1987548
May 25 16:40:44.603741 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:40:44.616969 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cfb939e-fc44-4eb4-8cce-b962c3bad3b3 None None] Sync routers for ids ['103a2116-9bde-4af3-9e28-4c356cf4c6f7'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:40:44.620204 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] 10.222.0.73 "PUT /v2.0/routers/103a2116-9bde-4af3-9e28-4c356cf4c6f7/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9296479
May 25 16:40:44.620427 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56058) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:44.627893 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cfb939e-fc44-4eb4-8cce-b962c3bad3b3 None None] Routers {'103a2116-9bde-4af3-9e28-4c356cf4c6f7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:40:44.628279 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-6cfb939e-fc44-4eb4-8cce-b962c3bad3b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b97bbe0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:40:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['103a2116-9bde-4af3-9e28-4c356cf4c6f7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:44.635124 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8aa112b4-3f9e-4844-b2d3-9392f69bd6ee req-e7a8133d-573e-4b0e-b330-8103ac7f01be tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/security-groups?id=15d6eaab-0e64-4634-b6b7-08f52c8b7bc4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0775247
May 25 16:40:44.664606 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-73b33934-af5a-4e4f-a8ac-9436ca73016a service neutron] 10.222.0.76 "GET /v2.0/networks/1235741b-b9bd-40c7-a0a4-63bc412a6700?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1845238
May 25 16:40:44.808324 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Notify callbacks [] for router, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:44.809777 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-6cfb939e-fc44-4eb4-8cce-b962c3bad3b3 None None] Set router 103a2116-9bde-4af3-9e28-4c356cf4c6f7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:40:44.810878 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d41abdb7-7a2b-401e-9b2d-a56cc799dd9c req-0756fa22-962f-4852-8c87-2161684a6cc9 service neutron] 10.222.0.76 "GET /v2.0/networks/1235741b-b9bd-40c7-a0a4-63bc412a6700?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1363699
May 25 16:40:44.937147 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4410c5-14d8-4ab5-9eb3-5a094aaf4474 req-b5b09601-9f99-4168-864f-8b73091d9d09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:44.938675 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4410c5-14d8-4ab5-9eb3-5a094aaf4474 req-b5b09601-9f99-4168-864f-8b73091d9d09 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=24825da1d862442b81b3c8836f431b59&device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 1100 time: 0.0789437
May 25 16:40:45.111432 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4410c5-14d8-4ab5-9eb3-5a094aaf4474 req-d122f233-87ca-47bd-a741-abd135c5e014 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:45.112957 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4410c5-14d8-4ab5-9eb3-5a094aaf4474 req-d122f233-87ca-47bd-a741-abd135c5e014 service neutron] 10.222.0.76 "GET /v2.0/networks?id=1235741b-b9bd-40c7-a0a4-63bc412a6700 HTTP/1.1" status: 200  len: 870 time: 0.1632102
May 25 16:40:45.119676 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:45.132041 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-6cfb939e-fc44-4eb4-8cce-b962c3bad3b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b97bbe0>, [{'id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'name': 'tempest-ServerRescueNegativeTestJSON-32259621-router', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:20Z', 'updated_at': '2021-05-25T16:40:43Z', 'revision_number': 5, 'project_id': 'fe57668427364ea7acb08a0f7f2826ed', 'gw_port': {'id': 'ac87ab76-935f-4d0f-8362-43317047f063', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:7a:36:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:45.135967 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cfb939e-fc44-4eb4-8cce-b962c3bad3b3 None None] Checking router: 103a2116-9bde-4af3-9e28-4c356cf4c6f7 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:40:45.144631 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cfb939e-fc44-4eb4-8cce-b962c3bad3b3 None None] Routers {'103a2116-9bde-4af3-9e28-4c356cf4c6f7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:40:45.145279 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-6cfb939e-fc44-4eb4-8cce-b962c3bad3b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b97bbe0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:40:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['103a2116-9bde-4af3-9e28-4c356cf4c6f7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:45.197862 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4410c5-14d8-4ab5-9eb3-5a094aaf4474 req-e10ee6f4-8894-4961-b653-ce804704eab8 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.94&port_id=75c8b59d-a367-490d-8805-67d51d1d66e4 HTTP/1.1" status: 200  len: 217 time: 0.0741754
May 25 16:40:45.203566 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Deleting port ac87ab76-935f-4d0f-8362-43317047f063 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:40:45.204249 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:45.280623 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4410c5-14d8-4ab5-9eb3-5a094aaf4474 req-0f7cccf5-308b-40b0-931a-3f0d5c93493d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:45.280623 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4410c5-14d8-4ab5-9eb3-5a094aaf4474 req-0f7cccf5-308b-40b0-931a-3f0d5c93493d service neutron] 10.222.0.76 "GET /v2.0/subnets?id=3c2b6433-203d-442f-b9b1-64f968f23228 HTTP/1.1" status: 200  len: 843 time: 0.0744150
May 25 16:40:45.335762 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-6cfb939e-fc44-4eb4-8cce-b962c3bad3b3 None None] Set router 103a2116-9bde-4af3-9e28-4c356cf4c6f7 gateway port host: None {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:40:45.345958 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] For port ac87ab76-935f-4d0f-8362-43317047f063, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=ac87ab76-935f-4d0f-8362-43317047f063,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:45.346540 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:45.363883 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4410c5-14d8-4ab5-9eb3-5a094aaf4474 req-d6425e32-fe3d-4650-aa00-b8efae028abe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:45.366005 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4410c5-14d8-4ab5-9eb3-5a094aaf4474 req-d6425e32-fe3d-4650-aa00-b8efae028abe service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=1235741b-b9bd-40c7-a0a4-63bc412a6700&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.0806983
May 25 16:40:45.474634 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-6cfb939e-fc44-4eb4-8cce-b962c3bad3b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b97bbe0>, [{'id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'name': 'tempest-ServerRescueNegativeTestJSON-32259621-router', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:20Z', 'updated_at': '2021-05-25T16:40:45Z', 'revision_number': 6, 'project_id': 'fe57668427364ea7acb08a0f7f2826ed', 'gw_port_host': None}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:45.479818 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cfb939e-fc44-4eb4-8cce-b962c3bad3b3 None None] The sync data for ids ['103a2116-9bde-4af3-9e28-4c356cf4c6f7'] in dv-cinder-786386-6-iscsi is: [{'id': '103a2116-9bde-4af3-9e28-4c356cf4c6f7', 'name': 'tempest-ServerRescueNegativeTestJSON-32259621-router', 'tenant_id': 'fe57668427364ea7acb08a0f7f2826ed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:20Z', 'updated_at': '2021-05-25T16:40:45Z', 'revision_number': 6, 'project_id': 'fe57668427364ea7acb08a0f7f2826ed', 'gw_port_host': None}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:40:45.485278 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Calling delete_port for ac87ab76-935f-4d0f-8362-43317047f063 owned by network:router_gateway {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:40:45.550043 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4410c5-14d8-4ab5-9eb3-5a094aaf4474 req-16cd5406-b296-4b6d-ad88-e9d37b8dccae service neutron] 10.222.0.76 "GET /v2.0/networks/1235741b-b9bd-40c7-a0a4-63bc412a6700?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1758754
May 25 16:40:45.692002 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:45.699178 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:45.762483 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Pushing event deleted for resources: {'Port': ['ID=ac87ab76-935f-4d0f-8362-43317047f063,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:45.778830 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4410c5-14d8-4ab5-9eb3-5a094aaf4474 req-50d070af-ee54-4624-8500-368c362bcf57 service neutron] 10.222.0.76 "GET /v2.0/networks/1235741b-b9bd-40c7-a0a4-63bc412a6700?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2216914
May 25 16:40:45.795103 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:45.830393 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37678319-d25f-4262-af92-784cc877ecfe req-1387fcc0-efce-4914-84dd-212dd89402c3 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:45.831866 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-37678319-d25f-4262-af92-784cc877ecfe req-1387fcc0-efce-4914-84dd-212dd89402c3 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1825273
May 25 16:40:45.858738 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-501045'] for router_gateway, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:45.892588 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-37678319-d25f-4262-af92-784cc877ecfe req-1247d857-4dde-4ab1-be35-86ff7123d78c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0511274
May 25 16:40:45.906364 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ce9107c-feee-4bbb-a1c3-e52d93c22cb9 req-151aec9b-8cc1-4179-9c9b-90a661492ef4 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:45.907763 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2ce9107c-feee-4bbb-a1c3-e52d93c22cb9 req-151aec9b-8cc1-4179-9c9b-90a661492ef4 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 947 time: 0.1327062
May 25 16:40:45.968868 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2ce9107c-feee-4bbb-a1c3-e52d93c22cb9 req-270a5a80-98c3-4ab5-a121-bef633d21d6e tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/security-groups?id=15d6eaab-0e64-4634-b6b7-08f52c8b7bc4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0444450
May 25 16:40:46.039220 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-507064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2357'] for router, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:46.041357 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:46.126828 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-507780'] for router, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:46.127454 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 103a2116-9bde-4af3-9e28-4c356cf4c6f7 {{(pid=92012) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 16:40:46.140549 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Notify callbacks [] for router, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:46.141673 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] 10.222.0.73 "DELETE /v2.0/routers/103a2116-9bde-4af3-9e28-4c356cf4c6f7 HTTP/1.1" status: 204  len: 168 time: 1.5203373
May 25 16:40:46.144175 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56082) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:46.207322 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_v2 [None req-38561a39-2147-4510-8a2f-909adb87de71 admin admin] Deleting subnet 5e6146eb-31ff-437b-a594-8ddb1d63042e {{(pid=92012) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:40:46.210200 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-38561a39-2147-4510-8a2f-909adb87de71 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:46.260690 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-38561a39-2147-4510-8a2f-909adb87de71 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-976079'] for subnet, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:46.318433 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-38561a39-2147-4510-8a2f-909adb87de71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:46.509393 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 75c8b59d-a367-490d-8805-67d51d1d66e4 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:40:46.670085 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 75c8b59d-a367-490d-8805-67d51d1d66e4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=75c8b59d-a367-490d-8805-67d51d1d66e4,segment=NetworkSegment(1f2c9fdf-ae4e-491a-b3be-e5a8b549664a),segment_id=1f2c9fdf-ae4e-491a-b3be-e5a8b549664a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:46.685705 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '75c8b59d-a367-490d-8805-67d51d1d66e4', 'network_id': '1235741b-b9bd-40c7-a0a4-63bc412a6700', 'port_id': '75c8b59d-a367-490d-8805-67d51d1d66e4', 'mac_address': 'fa:16:3e:97:ff:9f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 415, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3c2b6433-203d-442f-b9b1-64f968f23228', 'ip_address': '192.168.233.94'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:40:46.687087 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-38561a39-2147-4510-8a2f-909adb87de71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7721505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-697619'] for subnet, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:46.691285 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:46.727385 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38561a39-2147-4510-8a2f-909adb87de71 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5e6146eb-31ff-437b-a594-8ddb1d63042e,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:46.730337 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-38561a39-2147-4510-8a2f-909adb87de71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:46.732015 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-38561a39-2147-4510-8a2f-909adb87de71 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:46.739479 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-38561a39-2147-4510-8a2f-909adb87de71 admin admin] 10.222.0.73 "DELETE /v2.0/subnets/5e6146eb-31ff-437b-a594-8ddb1d63042e HTTP/1.1" status: 204  len: 168 time: 0.5921133
May 25 16:40:46.740316 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56092) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:46.745667 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:46.763930 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 75c8b59d-a367-490d-8805-67d51d1d66e4 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:40:46.783212 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 75c8b59d-a367-490d-8805-67d51d1d66e4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=75c8b59d-a367-490d-8805-67d51d1d66e4,segment=NetworkSegment(1f2c9fdf-ae4e-491a-b3be-e5a8b549664a),segment_id=1f2c9fdf-ae4e-491a-b3be-e5a8b549664a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:46.787900 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:46.788683 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 07e04c0f-8286-42fc-96c2-0e366da529c6 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:40:46.852250 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:46.872132 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-7b1535ab-78eb-405a-aa90-ee39b826251b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:46.976535 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 07e04c0f-8286-42fc-96c2-0e366da529c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=07e04c0f-8286-42fc-96c2-0e366da529c6,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:46.990763 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'port_id': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'mac_address': 'fa:16:3e:09:7e:45', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 414, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:40:47.005374 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:47.052958 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346b7a0670>,) {'filters': {'network_id': ['1186d694-166f-4246-b68b-e7ce60cb0f02']}} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:47.061696 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=75c8b59d-a367-490d-8805-67d51d1d66e4,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:47.065666 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:47.066614 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:47.083929 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b7a0670>, '227f55be-6fbd-4206-b845-6ee4d0737571') {'for_net_delete': True} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:47.083929 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b7a0670>, '227f55be-6fbd-4206-b845-6ee4d0737571') {} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:40:47.087621 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 07e04c0f-8286-42fc-96c2-0e366da529c6 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:40:47.103021 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device f766da42-735a-4b61-b332-9e92e16398ce no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:40:47.111572 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-976068'] for segment, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:47.134756 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:47.135982 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 07e04c0f-8286-42fc-96c2-0e366da529c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=07e04c0f-8286-42fc-96c2-0e366da529c6,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:47.142227 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] Releasing vlan 403 on physical network physnet1 to pool {{(pid=92012) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:40:47.143250 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: f766da42-735a-4b61-b332-9e92e16398ce {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:40:47.143745 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device f766da42-735a-4b61-b332-9e92e16398ce not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:40:47.144339 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device ac87ab76-935f-4d0f-8362-43317047f063 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:40:47.152445 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7823239'] for segment, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]: Traceback (most recent call last):
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     timer()
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     cb(*args, **kw)
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     return func(*args, **kwargs)
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     self._notify()
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     self.callback(batched_events)
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     event.method(event)
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     return f(self, *a, **k)
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._get(url).json()
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self.request(url, 'GET', **kwargs)
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:40:47.172558 dv-cinder-786386-6-iscsi neutron-server[92012]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:40:47.178745 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:47.191550 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:47.228119 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: ac87ab76-935f-4d0f-8362-43317047f063 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:40:47.228470 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device ac87ab76-935f-4d0f-8362-43317047f063 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:40:47.280845 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=07e04c0f-8286-42fc-96c2-0e366da529c6,revision_number=6']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:47.284728 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:47.311827 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:47.317444 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['07e04c0f-8286-42fc-96c2-0e366da529c6'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:40:47.330142 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:47.343518 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-25d6bfbb-3d6f-4c10-be36-c3165d6062ea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:47.376661 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] Pushing event deleted for resources: {'Network': ['ID=1186d694-166f-4246-b68b-e7ce60cb0f02,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:47.382002 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:47.387201 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] 10.222.0.73 "DELETE /v2.0/networks/1186d694-166f-4246-b68b-e7ce60cb0f02 HTTP/1.1" status: 204  len: 168 time: 0.6446781
May 25 16:40:47.426221 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48afa85f-c0b1-4303-a2d9-f8817966e688 req-c214d029-4756-482f-9d94-6eb764ee5794 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:47.429913 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-48afa85f-c0b1-4303-a2d9-f8817966e688 req-c214d029-4756-482f-9d94-6eb764ee5794 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 944 time: 0.3324990
May 25 16:40:47.464747 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd917d9-0016-49e0-9069-64c26a42b286 req-e0f03586-3e00-4ca5-a8b1-3413d389b877 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:47.466212 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ddd917d9-0016-49e0-9069-64c26a42b286 req-e0f03586-3e00-4ca5-a8b1-3413d389b877 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 948 time: 0.1836572
May 25 16:40:47.511245 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-48afa85f-c0b1-4303-a2d9-f8817966e688 req-1087fc5f-5f14-41e9-8b4d-b3d075caa0dd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0753014
May 25 16:40:47.543703 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ddd917d9-0016-49e0-9069-64c26a42b286 req-7f214087-6893-42b1-be41-d5edbad5c2af tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/security-groups?id=15d6eaab-0e64-4634-b6b7-08f52c8b7bc4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0596287
May 25 16:40:47.568750 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['75c8b59d-a367-490d-8805-67d51d1d66e4'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:40:47.607829 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 56110) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:47.662471 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-472b6e1f-3cdc-4f56-82b1-e885a1da8348 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=fe57668427364ea7acb08a0f7f2826ed&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0522640
May 25 16:40:47.664466 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 56114) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:47.728222 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-871e07df-4a4d-4ce2-abbb-72e132606e41 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:47.755242 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-871e07df-4a4d-4ce2-abbb-72e132606e41 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:47.810666 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-871e07df-4a4d-4ce2-abbb-72e132606e41 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:47.814246 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-5639742d-dbcf-437f-9c32-32bda1223bf4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:47.824786 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-871e07df-4a4d-4ce2-abbb-72e132606e41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=65702db5-e301-4057-a8d9-21523ce3a5da,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:47.828694 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-871e07df-4a4d-4ce2-abbb-72e132606e41 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:47.834661 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-871e07df-4a4d-4ce2-abbb-72e132606e41 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:47.835829 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-871e07df-4a4d-4ce2-abbb-72e132606e41 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/65702db5-e301-4057-a8d9-21523ce3a5da HTTP/1.1" status: 204  len: 168 time: 0.1703796
May 25 16:40:48.520960 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 75c8b59d-a367-490d-8805-67d51d1d66e4 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:40:48.675959 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 75c8b59d-a367-490d-8805-67d51d1d66e4 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:40:48.681990 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 75c8b59d-a367-490d-8805-67d51d1d66e4 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:40:48.682526 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:48.863409 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:48.902066 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 75c8b59d-a367-490d-8805-67d51d1d66e4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=75c8b59d-a367-490d-8805-67d51d1d66e4,segment=NetworkSegment(1f2c9fdf-ae4e-491a-b3be-e5a8b549664a),segment_id=1f2c9fdf-ae4e-491a-b3be-e5a8b549664a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:48.903499 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b324d3c0-cab5-450f-836c-0a8be9eebe3e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75c8b59d-a367-490d-8805-67d51d1d66e4'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:40:48.912262 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:48.913522 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 07e04c0f-8286-42fc-96c2-0e366da529c6 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:40:48.952614 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:49.041607 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5481cc0-8939-437c-8b30-cc94b1b9daa3 req-1cd6270e-6476-4009-a7b6-e35f8dcff375 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:49.051801 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b5481cc0-8939-437c-8b30-cc94b1b9daa3 req-1cd6270e-6476-4009-a7b6-e35f8dcff375 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 944 time: 0.3211129
May 25 16:40:49.141567 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8e9e485-0406-4868-9317-4de57cb8b2de req-77bac5c1-a86c-4813-b14b-616eb697c454 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:49.143137 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a8e9e485-0406-4868-9317-4de57cb8b2de req-77bac5c1-a86c-4813-b14b-616eb697c454 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 949 time: 0.3201325
May 25 16:40:49.145590 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 07e04c0f-8286-42fc-96c2-0e366da529c6 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:40:49.146530 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:49.267606 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=75c8b59d-a367-490d-8805-67d51d1d66e4,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:49.270410 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a8e9e485-0406-4868-9317-4de57cb8b2de req-3f24ae60-2ced-42b1-8c18-f843d23b2142 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/security-groups?id=15d6eaab-0e64-4634-b6b7-08f52c8b7bc4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0998361
May 25 16:40:49.284388 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b5481cc0-8939-437c-8b30-cc94b1b9daa3 req-a21766be-dc35-410e-8c75-9f6de8fba44c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2221925
May 25 16:40:49.303020 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.350s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:49.436667 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b324d3c0-cab5-450f-836c-0a8be9eebe3e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75c8b59d-a367-490d-8805-67d51d1d66e4', 'code': 200}
May 25 16:40:49.464871 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:49.554816 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 07e04c0f-8286-42fc-96c2-0e366da529c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=07e04c0f-8286-42fc-96c2-0e366da529c6,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:49.564875 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:49.567005 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:49.691496 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=07e04c0f-8286-42fc-96c2-0e366da529c6,revision_number=7']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:49.694739 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:49.810838 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d4071d1-e359-47f7-878f-08504dbe5f2a req-c3fab298-8171-4bf0-8d68-03567c614893 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:49.812414 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9d4071d1-e359-47f7-878f-08504dbe5f2a req-c3fab298-8171-4bf0-8d68-03567c614893 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 1102 time: 0.1538279
May 25 16:40:49.876103 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9d4071d1-e359-47f7-878f-08504dbe5f2a req-7b3eae94-766a-462d-845a-a71e03e71b1c service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=15d6eaab-0e64-4634-b6b7-08f52c8b7bc4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0509572
May 25 16:40:50.592326 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c716954f-332f-41fe-b64a-b8c69596739d req-9f2ed691-ab6f-471e-9df4-0cb274e30a32 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:50.600605 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c716954f-332f-41fe-b64a-b8c69596739d req-9f2ed691-ab6f-471e-9df4-0cb274e30a32 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 949 time: 0.2108152
May 25 16:40:50.729015 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2991fc3c-ea0f-4a34-b7b3-91fa046761ea req-03320868-721d-4287-9ae4-fd3969e653e5 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:50.739751 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2991fc3c-ea0f-4a34-b7b3-91fa046761ea req-03320868-721d-4287-9ae4-fd3969e653e5 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.2365839
May 25 16:40:50.744447 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c716954f-332f-41fe-b64a-b8c69596739d req-e72560df-92e4-44aa-a2aa-72f52faa5ee5 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/security-groups?id=15d6eaab-0e64-4634-b6b7-08f52c8b7bc4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1429732
May 25 16:40:50.876589 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2991fc3c-ea0f-4a34-b7b3-91fa046761ea req-9a6fbc82-a0ad-4e47-aa74-8ed5e62f5063 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1231399
May 25 16:40:51.437778 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:40:51.522722 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'code': 200}
May 25 16:40:51.667546 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8461684a-9bf0-490c-bbba-a8fc67763cd8 req-985ad0ac-47e8-4826-a9bd-047f0b471b3a tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:51.667546 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8461684a-9bf0-490c-bbba-a8fc67763cd8 req-985ad0ac-47e8-4826-a9bd-047f0b471b3a tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1594303
May 25 16:40:51.764471 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8461684a-9bf0-490c-bbba-a8fc67763cd8 req-2f384519-4d97-4ace-bc7e-fb8f8bdc0c76 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1159763
May 25 16:40:51.978809 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82451f38-381a-4b53-898f-61d39ef4f859 req-ef811ec1-b612-40ed-80a9-cc4290bbbdc9 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:51.980281 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-82451f38-381a-4b53-898f-61d39ef4f859 req-ef811ec1-b612-40ed-80a9-cc4290bbbdc9 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 949 time: 0.0880442
May 25 16:40:52.090150 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-82451f38-381a-4b53-898f-61d39ef4f859 req-1a3d2281-6157-4a4f-bfd0-9d1833ecd577 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/security-groups?id=15d6eaab-0e64-4634-b6b7-08f52c8b7bc4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1030290
May 25 16:40:52.196602 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d08086bb-1251-472f-9fb2-d65133c2bb39 req-4dec466d-79a6-4f61-8e33-6839c29982eb tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:52.198241 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d08086bb-1251-472f-9fb2-d65133c2bb39 req-4dec466d-79a6-4f61-8e33-6839c29982eb tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1722617
May 25 16:40:52.282607 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d08086bb-1251-472f-9fb2-d65133c2bb39 req-deefedaa-a83c-430d-8bb4-9432eaddc040 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0755033
May 25 16:40:52.640246 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4951f348-d1e1-4fae-bb49-9aaf5e1f8e9a req-b0a7dfd2-f78c-4d31-a971-4e7525252113 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:52.641782 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4951f348-d1e1-4fae-bb49-9aaf5e1f8e9a req-b0a7dfd2-f78c-4d31-a971-4e7525252113 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 949 time: 0.1116941
May 25 16:40:52.695007 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4951f348-d1e1-4fae-bb49-9aaf5e1f8e9a req-4f17ca48-a574-44c0-a0d6-b225567a9537 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/security-groups?id=15d6eaab-0e64-4634-b6b7-08f52c8b7bc4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0459628
May 25 16:40:52.977916 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b160dbd-345a-4b01-a071-6375ad24edd9 req-509014f9-9aa5-4576-a415-7d2ada26255e tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:52.984009 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9b160dbd-345a-4b01-a071-6375ad24edd9 req-509014f9-9aa5-4576-a415-7d2ada26255e tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0987363
May 25 16:40:53.029304 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9b160dbd-345a-4b01-a071-6375ad24edd9 req-581d84c2-8543-4b7d-9722-d4524b8ce4ec tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435932
May 25 16:40:53.502595 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:40:53.598266 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fda5f0d6-3fec-45aa-840a-db05ee035c49 req-2967d34d-4094-4070-82cd-437ec2296668 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:53.606755 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fda5f0d6-3fec-45aa-840a-db05ee035c49 req-2967d34d-4094-4070-82cd-437ec2296668 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1865814
May 25 16:40:53.684188 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fda5f0d6-3fec-45aa-840a-db05ee035c49 req-4aaffd9f-7fd1-47bf-8f88-2931886ea4ce tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0657067
May 25 16:40:53.933562 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fa976b1-e44b-49be-80d9-7fa4d387e849 req-a095ca2a-02c6-4a8b-b5f0-18b117c5f0e2 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:53.936304 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1fa976b1-e44b-49be-80d9-7fa4d387e849 req-a095ca2a-02c6-4a8b-b5f0-18b117c5f0e2 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 949 time: 0.0984125
May 25 16:40:53.994622 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1fa976b1-e44b-49be-80d9-7fa4d387e849 req-c193328e-c5fa-440a-8061-117168764522 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/security-groups?id=15d6eaab-0e64-4634-b6b7-08f52c8b7bc4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0526001
May 25 16:40:54.099815 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c128652-dfa0-4189-b30b-9aec6999a341 req-16b20695-dfbe-451b-8b60-2e868e7d1715 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:54.101419 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9c128652-dfa0-4189-b30b-9aec6999a341 req-16b20695-dfbe-451b-8b60-2e868e7d1715 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.76 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 949 time: 0.1007507
May 25 16:40:54.195522 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56314) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:54.342021 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f5237ae6-1bca-443c-8b29-dfc8866622a5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:54.360112 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f5237ae6-1bca-443c-8b29-dfc8866622a5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:40:54.364634 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f5237ae6-1bca-443c-8b29-dfc8866622a5 admin admin] Usage tracker for resource:security_group_rule and tenant:7b97282c5f87485bab0fb36b5c0a45e7 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:40:54.368045 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f5237ae6-1bca-443c-8b29-dfc8866622a5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:40:54.375232 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f5237ae6-1bca-443c-8b29-dfc8866622a5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:40:54.465622 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f169f93-23ff-4f34-89d8-2e99e7acc097 req-91fa7014-0b07-45f3-8c56-097b7f34a688 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:54.472202 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f5237ae6-1bca-443c-8b29-dfc8866622a5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:54.473342 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4f169f93-23ff-4f34-89d8-2e99e7acc097 req-91fa7014-0b07-45f3-8c56-097b7f34a688 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.2935815
May 25 16:40:54.480137 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f5237ae6-1bca-443c-8b29-dfc8866622a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:54.493136 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-9c128652-dfa0-4189-b30b-9aec6999a341 req-13a22f5a-72ee-4818-9a6d-ddc33991ab80 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Deleting port 75c8b59d-a367-490d-8805-67d51d1d66e4 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:40:54.495908 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-9c128652-dfa0-4189-b30b-9aec6999a341 req-13a22f5a-72ee-4818-9a6d-ddc33991ab80 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:54.513481 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3d8d44c0-74c4-4bcc-8d82-1dbff4c20141 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:54.526277 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f5237ae6-1bca-443c-8b29-dfc8866622a5 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=7b97282c5f87485bab0fb36b5c0a45e7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3296833
May 25 16:40:54.530536 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56320) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:54.578851 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5237ae6-1bca-443c-8b29-dfc8866622a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a052c4e-9779-4670-bb00-facbf9630d2a,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:54.601195 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f5237ae6-1bca-443c-8b29-dfc8866622a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:54.657679 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ff74238a-85d0-4482-beb5-0a358db25158 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:54.675695 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4f169f93-23ff-4f34-89d8-2e99e7acc097 req-476225f5-7a88-4e6b-9cce-3301e69be20b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1981514
May 25 16:40:54.729677 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ff74238a-85d0-4482-beb5-0a358db25158 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:54.792520 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-9c128652-dfa0-4189-b30b-9aec6999a341 req-13a22f5a-72ee-4818-9a6d-ddc33991ab80 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] For port 75c8b59d-a367-490d-8805-67d51d1d66e4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=75c8b59d-a367-490d-8805-67d51d1d66e4,segment=NetworkSegment(1f2c9fdf-ae4e-491a-b3be-e5a8b549664a),segment_id=1f2c9fdf-ae4e-491a-b3be-e5a8b549664a)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:40:54.792823 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-9c128652-dfa0-4189-b30b-9aec6999a341 req-13a22f5a-72ee-4818-9a6d-ddc33991ab80 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:54.797672 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ff74238a-85d0-4482-beb5-0a358db25158 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:54.801916 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a35e07d1-2883-43d2-9cdb-000fb5849616 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:54.814008 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff74238a-85d0-4482-beb5-0a358db25158 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a052c4e-9779-4670-bb00-facbf9630d2a,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:54.818490 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ff74238a-85d0-4482-beb5-0a358db25158 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:54.822773 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ff74238a-85d0-4482-beb5-0a358db25158 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:54.823983 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-ff74238a-85d0-4482-beb5-0a358db25158 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/8a052c4e-9779-4670-bb00-facbf9630d2a HTTP/1.1" status: 204  len: 168 time: 0.2920046
May 25 16:40:54.979217 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-9c128652-dfa0-4189-b30b-9aec6999a341 req-13a22f5a-72ee-4818-9a6d-ddc33991ab80 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Calling delete_port for 75c8b59d-a367-490d-8805-67d51d1d66e4 owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:40:55.126607 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e16ba3cf-eb94-41e8-9f45-681922bf448a req-9f35e038-cb08-49de-ab74-9da6b63674e0 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:55.128331 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e16ba3cf-eb94-41e8-9f45-681922bf448a req-9f35e038-cb08-49de-ab74-9da6b63674e0 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1165936
May 25 16:40:55.281287 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e16ba3cf-eb94-41e8-9f45-681922bf448a req-868dd4df-691a-43d7-8bd7-6b9e1cd7aa63 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1419852
May 25 16:40:55.297456 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56338) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:55.327216 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-9c128652-dfa0-4189-b30b-9aec6999a341 req-13a22f5a-72ee-4818-9a6d-ddc33991ab80 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:55.334639 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:55.338442 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-16855aa7-6749-4070-8c1d-1e4ec9021ea5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:55.361270 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-16855aa7-6749-4070-8c1d-1e4ec9021ea5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:40:55.366389 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-16855aa7-6749-4070-8c1d-1e4ec9021ea5 admin admin] Usage tracker for resource:security_group_rule and tenant:0b5f6b8a66574e478854f96268a0b565 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:40:55.369475 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-16855aa7-6749-4070-8c1d-1e4ec9021ea5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:40:55.376257 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-16855aa7-6749-4070-8c1d-1e4ec9021ea5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:40:55.385108 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13a22f5a-72ee-4818-9a6d-ddc33991ab80 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Pushing event deleted for resources: {'Port': ['ID=75c8b59d-a367-490d-8805-67d51d1d66e4,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:55.390484 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-13a22f5a-72ee-4818-9a6d-ddc33991ab80 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:55.400951 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c53355c4-b657-4783-a637-080b11d89dd5 req-df3d4221-ff80-481b-a17e-c9d5758e04cb tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:55.408527 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c53355c4-b657-4783-a637-080b11d89dd5 req-df3d4221-ff80-481b-a17e-c9d5758e04cb tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/ports?device_id=b324d3c0-cab5-450f-836c-0a8be9eebe3e HTTP/1.1" status: 200  len: 949 time: 0.2337077
May 25 16:40:55.522498 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-16855aa7-6749-4070-8c1d-1e4ec9021ea5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:55.531517 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-16855aa7-6749-4070-8c1d-1e4ec9021ea5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:55.547375 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-9c128652-dfa0-4189-b30b-9aec6999a341 req-13a22f5a-72ee-4818-9a6d-ddc33991ab80 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] No DVR routers for this DVR port 75c8b59d-a367-490d-8805-67d51d1d66e4 on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:40:55.551456 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-957da9c6-9208-4f93-9436-7106fd10b2e8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:55.560449 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-9c128652-dfa0-4189-b30b-9aec6999a341 req-13a22f5a-72ee-4818-9a6d-ddc33991ab80 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:55.570996 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b324d3c0-cab5-450f-836c-0a8be9eebe3e', 'name': 'network-vif-deleted', 'tag': '75c8b59d-a367-490d-8805-67d51d1d66e4'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:40:55.595017 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9c128652-dfa0-4189-b30b-9aec6999a341 req-13a22f5a-72ee-4818-9a6d-ddc33991ab80 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.76 "DELETE /v2.0/ports/75c8b59d-a367-490d-8805-67d51d1d66e4 HTTP/1.1" status: 204  len: 173 time: 1.4857097
May 25 16:40:55.623838 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-16855aa7-6749-4070-8c1d-1e4ec9021ea5 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=0b5f6b8a66574e478854f96268a0b565&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3236461
May 25 16:40:55.625299 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16855aa7-6749-4070-8c1d-1e4ec9021ea5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=20b7e6fb-4c39-433a-9c47-4833136a58a8,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:55.632059 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-16855aa7-6749-4070-8c1d-1e4ec9021ea5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:55.632992 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56344) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:40:55.666064 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c53355c4-b657-4783-a637-080b11d89dd5 req-fb9b1111-8898-4dc1-93a4-cad94c7bdd94 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] 10.222.0.73 "GET /v2.0/security-groups?id=15d6eaab-0e64-4634-b6b7-08f52c8b7bc4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2565267
May 25 16:40:55.667805 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b324d3c0-cab5-450f-836c-0a8be9eebe3e', 'name': 'network-vif-deleted', 'tag': '75c8b59d-a367-490d-8805-67d51d1d66e4', 'status': 'completed', 'code': 200}
May 25 16:40:55.738372 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b89759d1-453f-4650-b96c-a7d07642f36d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:55.769112 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b89759d1-453f-4650-b96c-a7d07642f36d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:55.834811 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b89759d1-453f-4650-b96c-a7d07642f36d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:55.843399 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a61e467d-83af-4939-b82b-0702d345dac9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:40:55.858532 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b89759d1-453f-4650-b96c-a7d07642f36d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=20b7e6fb-4c39-433a-9c47-4833136a58a8,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:40:55.860597 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b89759d1-453f-4650-b96c-a7d07642f36d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:40:55.875706 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-b89759d1-453f-4650-b96c-a7d07642f36d admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/20b7e6fb-4c39-433a-9c47-4833136a58a8 HTTP/1.1" status: 204  len: 168 time: 0.2293949
May 25 16:40:55.877178 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b89759d1-453f-4650-b96c-a7d07642f36d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:40:56.004199 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6041ffb3-8647-4517-a5fd-184ca480dd34 req-542720bc-0bd1-4629-9b2a-0f23121236f4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:56.005794 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6041ffb3-8647-4517-a5fd-184ca480dd34 req-542720bc-0bd1-4629-9b2a-0f23121236f4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1076717
May 25 16:40:56.058605 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6041ffb3-8647-4517-a5fd-184ca480dd34 req-9857dcca-bbd2-41f3-be1b-cabdb5163438 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0434580
May 25 16:40:56.524949 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ac61c86-97a9-4fda-85f5-c7fe90353df4 req-ec05f878-03ab-4656-a22a-1429ea7e76b5 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:56.531803 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8ac61c86-97a9-4fda-85f5-c7fe90353df4 req-ec05f878-03ab-4656-a22a-1429ea7e76b5 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1000409
May 25 16:40:56.567125 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 75c8b59d-a367-490d-8805-67d51d1d66e4 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:40:56.654389 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8ac61c86-97a9-4fda-85f5-c7fe90353df4 req-b166e5cb-1977-4433-a8ca-145c059603bd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1192255
May 25 16:40:56.725829 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 75c8b59d-a367-490d-8805-67d51d1d66e4 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:40:56.726140 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 75c8b59d-a367-490d-8805-67d51d1d66e4 not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:40:57.357040 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c5825e-0074-4dd2-8183-42b839f3adae req-f14eebc8-3d6b-40f2-9454-7dceaf6e9c90 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:57.359979 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-28c5825e-0074-4dd2-8183-42b839f3adae req-f14eebc8-3d6b-40f2-9454-7dceaf6e9c90 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1618192
May 25 16:40:57.471501 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-28c5825e-0074-4dd2-8183-42b839f3adae req-ce1bb0b1-21b6-4b76-92a2-884e2855c016 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0986202
May 25 16:40:57.985178 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49800deb-fb8b-4953-aafa-6dde1b8efb4a req-8b0eefe5-2c74-448e-9375-918d996d9966 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:57.993324 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-49800deb-fb8b-4953-aafa-6dde1b8efb4a req-8b0eefe5-2c74-448e-9375-918d996d9966 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1683989
May 25 16:40:58.053868 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-49800deb-fb8b-4953-aafa-6dde1b8efb4a req-ad02a027-d5f5-44a5-b063-2a511e0dc19a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0593855
May 25 16:40:58.743225 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2c9c1a-2d98-472e-b442-7c51c87c913b req-c234864e-6dbd-4023-acb6-46a03a987b4c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:58.752266 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8b2c9c1a-2d98-472e-b442-7c51c87c913b req-c234864e-6dbd-4023-acb6-46a03a987b4c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1203735
May 25 16:40:58.811747 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8b2c9c1a-2d98-472e-b442-7c51c87c913b req-8d1f41ae-8e49-4b4e-95e4-de22db3dd9f7 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0584028
May 25 16:40:59.363476 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6df702ae-6ed0-473c-8df8-e0ad3fff205b req-a845a32d-de31-44b0-8b6a-6436d02bb556 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:40:59.365635 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6df702ae-6ed0-473c-8df8-e0ad3fff205b req-a845a32d-de31-44b0-8b6a-6436d02bb556 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1853561
May 25 16:40:59.425850 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6df702ae-6ed0-473c-8df8-e0ad3fff205b req-fe059662-baf3-48e5-908a-6e4b6f3f2a0c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0545948
May 25 16:41:00.052601 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c08ce252-d048-4e0a-a86a-d856f0dc341a req-9947b8da-7687-4217-a6fc-7e3c4f5dc9a8 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:00.054217 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c08ce252-d048-4e0a-a86a-d856f0dc341a req-9947b8da-7687-4217-a6fc-7e3c4f5dc9a8 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1229751
May 25 16:41:00.126885 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c08ce252-d048-4e0a-a86a-d856f0dc341a req-76878a96-fa5d-4ac6-bbcd-12749b38f54c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0499794
May 25 16:41:00.670048 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f4ed51-62f0-4c10-9ee1-ef8b6a085dc4 req-8cef90ca-8e51-4a4d-bb4d-044338de4162 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:00.677330 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e8f4ed51-62f0-4c10-9ee1-ef8b6a085dc4 req-8cef90ca-8e51-4a4d-bb4d-044338de4162 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1027825
May 25 16:41:00.744996 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e8f4ed51-62f0-4c10-9ee1-ef8b6a085dc4 req-9d0b6c70-9899-4877-aed2-396167ebb426 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0668037
May 25 16:41:01.323276 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e9a54f2-bf7e-46a5-9f76-5dceac177e71 req-ed1ede82-0917-4da9-978d-096ff582ef15 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:01.325061 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6e9a54f2-bf7e-46a5-9f76-5dceac177e71 req-ed1ede82-0917-4da9-978d-096ff582ef15 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0828269
May 25 16:41:01.380251 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6e9a54f2-bf7e-46a5-9f76-5dceac177e71 req-36a5b760-42eb-4ddb-8c7a-f7e159be96bc tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0456228
May 25 16:41:01.409472 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9673fbf-0755-4a40-8baa-5b1b5c6f0189 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:02.018257 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4606fbc2-1f94-4324-9ddd-e6f7bd66a60e req-ce346ef0-58cb-4b4c-a01e-ed784806e17b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:02.020938 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4606fbc2-1f94-4324-9ddd-e6f7bd66a60e req-ce346ef0-58cb-4b4c-a01e-ed784806e17b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1618998
May 25 16:41:02.071948 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4606fbc2-1f94-4324-9ddd-e6f7bd66a60e req-e6a428fc-18a0-4252-b443-0bb9e0e8dafc tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0462105
May 25 16:41:02.565168 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5cde35-69a2-4ad1-a86c-c90877da8ab3 req-f37a1118-07c1-48f9-9348-6bbd418bdaa0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:02.566675 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3b5cde35-69a2-4ad1-a86c-c90877da8ab3 req-f37a1118-07c1-48f9-9348-6bbd418bdaa0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0818858
May 25 16:41:02.613781 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3b5cde35-69a2-4ad1-a86c-c90877da8ab3 req-7ea1da18-9d84-4e52-8653-6520542c1bae tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0413053
May 25 16:41:03.257115 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e944e02-e9d3-44d0-a386-37304442bbfc req-33ad5a46-68bb-442a-aadc-39abebe148a1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:03.258449 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4e944e02-e9d3-44d0-a386-37304442bbfc req-33ad5a46-68bb-442a-aadc-39abebe148a1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.0794978
May 25 16:41:03.303998 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4e944e02-e9d3-44d0-a386-37304442bbfc req-871c6665-06cb-4d43-9784-42e378292b71 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0398147
May 25 16:41:03.807818 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f74ba5c-8ecb-48c6-9561-4383f8c27a3b req-6fd7e7e8-ae38-4ab5-9ce5-900a80d32474 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:03.809200 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8f74ba5c-8ecb-48c6-9561-4383f8c27a3b req-6fd7e7e8-ae38-4ab5-9ce5-900a80d32474 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0888138
May 25 16:41:03.837747 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:03.856638 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8f74ba5c-8ecb-48c6-9561-4383f8c27a3b req-63e8afb8-acb8-4416-93ff-85c310ee8e12 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0413237
May 25 16:41:04.089444 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daedf89f-6274-4361-9f06-410b7d428795 req-fc48a05a-91ce-4fbd-a468-b33185bc7e2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:04.090912 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-daedf89f-6274-4361-9f06-410b7d428795 req-fc48a05a-91ce-4fbd-a468-b33185bc7e2e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9c4a08443867402386f8ec58d2615739&device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 1098 time: 0.0749216
May 25 16:41:04.116073 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-6b5551bc-b3dc-45b8-bc68-7d70524bf2c0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:04.240373 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daedf89f-6274-4361-9f06-410b7d428795 req-fe5ba1b9-ed5f-43ce-854d-4cf7baa9611e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:04.241896 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-daedf89f-6274-4361-9f06-410b7d428795 req-fe5ba1b9-ed5f-43ce-854d-4cf7baa9611e service neutron] 10.222.0.76 "GET /v2.0/networks?id=b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 200  len: 918 time: 0.1394396
May 25 16:41:04.350690 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56738) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:04.371696 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-daedf89f-6274-4361-9f06-410b7d428795 req-198c64ec-6386-44e4-a583-da5759fcdf04 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=07e04c0f-8286-42fc-96c2-0e366da529c6 HTTP/1.1" status: 200  len: 1001 time: 0.1130233
May 25 16:41:04.503966 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daedf89f-6274-4361-9f06-410b7d428795 req-1d82fcff-4fb7-458b-9d90-fdd2fc0322ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:04.506216 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-daedf89f-6274-4361-9f06-410b7d428795 req-1d82fcff-4fb7-458b-9d90-fdd2fc0322ea service neutron] 10.222.0.76 "GET /v2.0/subnets?id=950695d6-8663-4ed4-92fd-b43d8ea5a820 HTTP/1.1" status: 200  len: 856 time: 0.1272600
May 25 16:41:04.515292 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-996b963f-45eb-46c1-980f-5c0342ae50bb admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=24825da1d862442b81b3c8836f431b59&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1634049
May 25 16:41:04.516095 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56750) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:04.578437 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-cdc70745-872a-494b-9858-485aa750ab41 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:04.595567 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb096093-d8a2-4e1d-acd6-bc3eefa89c94 req-3ebe9ee6-bb79-4f3e-811c-30f0708a439a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:04.596967 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eb096093-d8a2-4e1d-acd6-bc3eefa89c94 req-3ebe9ee6-bb79-4f3e-811c-30f0708a439a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.1574750
May 25 16:41:04.612760 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-cdc70745-872a-494b-9858-485aa750ab41 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:04.646180 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daedf89f-6274-4361-9f06-410b7d428795 req-7bbab276-01a1-4c5d-84df-8875ed986984 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:04.647644 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-daedf89f-6274-4361-9f06-410b7d428795 req-7bbab276-01a1-4c5d-84df-8875ed986984 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b8cabc9a-0f6f-485c-8020-441b42ac019b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1346629
May 25 16:41:04.655117 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eb096093-d8a2-4e1d-acd6-bc3eefa89c94 req-7227a2ac-cf6e-4e77-a325-31a4a9d42606 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0507398
May 25 16:41:04.673043 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-cdc70745-872a-494b-9858-485aa750ab41 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:04.677326 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-dd539ab6-8c2c-478f-a23e-96140d625679 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:04.691272 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdc70745-872a-494b-9858-485aa750ab41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=15d6eaab-0e64-4634-b6b7-08f52c8b7bc4,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:04.695867 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-cdc70745-872a-494b-9858-485aa750ab41 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:04.709787 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-cdc70745-872a-494b-9858-485aa750ab41 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:04.714958 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-cdc70745-872a-494b-9858-485aa750ab41 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/15d6eaab-0e64-4634-b6b7-08f52c8b7bc4 HTTP/1.1" status: 204  len: 168 time: 0.1968658
May 25 16:41:04.801276 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-daedf89f-6274-4361-9f06-410b7d428795 req-17880704-97be-45da-b0d2-8bbc3d9866f2 service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1438460
May 25 16:41:04.965016 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-daedf89f-6274-4361-9f06-410b7d428795 req-55982c0c-b17e-42a2-8b3c-11a1a3fda921 service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1572328
May 25 16:41:05.044167 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:05.081661 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da481f6c-e2d1-434e-8df9-f1c3c33c5617 req-3b5b6a51-652b-4462-b162-55c401bfc304 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:05.083621 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-da481f6c-e2d1-434e-8df9-f1c3c33c5617 req-3b5b6a51-652b-4462-b162-55c401bfc304 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0953264
May 25 16:41:05.129248 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-da481f6c-e2d1-434e-8df9-f1c3c33c5617 req-d809b3a5-b16b-4170-bd59-b182490b0450 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0398495
May 25 16:41:05.517307 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-959c9e75-b8d1-4fa0-9301-058d82544098 req-1c8585ae-ef51-472b-be38-641495501ad5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:05.518676 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-959c9e75-b8d1-4fa0-9301-058d82544098 req-1c8585ae-ef51-472b-be38-641495501ad5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1328676
May 25 16:41:05.552076 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3dab8e-7bcc-41c2-8b42-e0fe6eb072ab req-1947f468-abec-4400-91c6-5ca5e3f9544d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:05.553569 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ab3dab8e-7bcc-41c2-8b42-e0fe6eb072ab req-1947f468-abec-4400-91c6-5ca5e3f9544d service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=63f896ab0d7e44158204551033c33ba4&device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 1098 time: 0.1083179
May 25 16:41:05.636536 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-959c9e75-b8d1-4fa0-9301-058d82544098 req-fce8b220-ffa3-4382-9dd5-53cbc2eafadd tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1104851
May 25 16:41:05.800126 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3dab8e-7bcc-41c2-8b42-e0fe6eb072ab req-1a3c169c-d489-4e84-ac36-795e1a62ff02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:05.801096 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ab3dab8e-7bcc-41c2-8b42-e0fe6eb072ab req-1a3c169c-d489-4e84-ac36-795e1a62ff02 service neutron] 10.222.0.76 "GET /v2.0/networks?id=ce683266-622a-4b13-a610-301441bf2882 HTTP/1.1" status: 200  len: 912 time: 0.2389147
May 25 16:41:05.964454 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ab3dab8e-7bcc-41c2-8b42-e0fe6eb072ab req-5d7e20c0-15ff-4147-b568-7fc4935c8a44 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2b1a8c74-03d6-4f98-a405-94fc04b50dd4 HTTP/1.1" status: 200  len: 1001 time: 0.1257412
May 25 16:41:06.045891 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dde2b26-5a1f-4a98-a0f0-eb099ed67a0f req-3097c064-bfb4-4636-be93-d077338f1550 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:06.047725 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6dde2b26-5a1f-4a98-a0f0-eb099ed67a0f req-3097c064-bfb4-4636-be93-d077338f1550 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 945 time: 0.2492986
May 25 16:41:06.077158 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3dab8e-7bcc-41c2-8b42-e0fe6eb072ab req-1c6fe759-25ef-4351-a210-b0c685835130 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:06.078617 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ab3dab8e-7bcc-41c2-8b42-e0fe6eb072ab req-1c6fe759-25ef-4351-a210-b0c685835130 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=06161ba6-62a3-443f-9cfb-bccf3f60ad9c HTTP/1.1" status: 200  len: 850 time: 0.1058118
May 25 16:41:06.155759 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6dde2b26-5a1f-4a98-a0f0-eb099ed67a0f req-c8e246b0-5ec3-495d-be79-841d8481cc15 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1007676
May 25 16:41:06.180602 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3dab8e-7bcc-41c2-8b42-e0fe6eb072ab req-4b7b0e60-f7a7-4266-a1ba-9c3ea083cad4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:06.182100 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ab3dab8e-7bcc-41c2-8b42-e0fe6eb072ab req-4b7b0e60-f7a7-4266-a1ba-9c3ea083cad4 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ce683266-622a-4b13-a610-301441bf2882&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0954430
May 25 16:41:06.331944 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ab3dab8e-7bcc-41c2-8b42-e0fe6eb072ab req-7bbb5ad5-b7a7-4a79-87ed-d2926b261106 service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1416192
May 25 16:41:06.499038 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ab3dab8e-7bcc-41c2-8b42-e0fe6eb072ab req-ae0a335f-f3e4-4387-a880-67824032aac2 service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1594875
May 25 16:41:06.564087 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:06.597112 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 07e04c0f-8286-42fc-96c2-0e366da529c6 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:41:06.728627 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:06.757829 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:41:06.780570 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 07e04c0f-8286-42fc-96c2-0e366da529c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=07e04c0f-8286-42fc-96c2-0e366da529c6,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:41:06.788115 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:06.792103 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:06.831898 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'code': 200}
May 25 16:41:06.841804 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b49cbe27-9f35-4de9-a2f9-4e40d8bd6b6e req-4357540a-a26d-4496-9c2d-36676e5dd21f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:06.843278 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b49cbe27-9f35-4de9-a2f9-4e40d8bd6b6e req-4357540a-a26d-4496-9c2d-36676e5dd21f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0932856
May 25 16:41:06.881771 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=07e04c0f-8286-42fc-96c2-0e366da529c6,revision_number=8']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:06.885824 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:06.905010 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b49cbe27-9f35-4de9-a2f9-4e40d8bd6b6e req-7bb14090-b0a5-412c-b1b6-ae15786b02fb tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0554745
May 25 16:41:07.355485 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cbe6a97-ec7f-4aa3-9526-1c084005bd90 req-8b8427ac-e36b-4ac5-9e32-8de77daf1a0a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:07.356941 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6cbe6a97-ec7f-4aa3-9526-1c084005bd90 req-8b8427ac-e36b-4ac5-9e32-8de77daf1a0a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0820856
May 25 16:41:07.403826 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6cbe6a97-ec7f-4aa3-9526-1c084005bd90 req-545d37de-8609-440e-a460-66137e400fd2 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0410247
May 25 16:41:08.113686 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-128054e9-c01c-4bd9-a18e-03c2215c1534 req-0c2b8766-b0cf-40e4-ab28-619884c79a51 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:08.117876 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-128054e9-c01c-4bd9-a18e-03c2215c1534 req-0c2b8766-b0cf-40e4-ab28-619884c79a51 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1036370
May 25 16:41:08.165929 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-128054e9-c01c-4bd9-a18e-03c2215c1534 req-5443e019-9695-4d54-988e-526d24488908 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452404
May 25 16:41:08.393228 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a48ffbd4-4f2d-41dc-a3c7-bf37355f1638 req-d849b8ce-833e-4142-8e4b-989c18ec1e1d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:08.394882 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a48ffbd4-4f2d-41dc-a3c7-bf37355f1638 req-d849b8ce-833e-4142-8e4b-989c18ec1e1d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0970914
May 25 16:41:08.463630 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a48ffbd4-4f2d-41dc-a3c7-bf37355f1638 req-e7fa8e5c-1aa2-426c-b6e1-2dbf8c3460c1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0617213
May 25 16:41:08.769144 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56882) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:08.900285 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-261894ae-d5ab-4da0-b994-1ba5c26db9d4 service neutron] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1298795
May 25 16:41:09.668672 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bdfdd5e-143e-4ad5-baf1-e9d94e6cefd1 req-f8313e04-9dc6-4f32-8116-6845252bbd97 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:09.670127 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1bdfdd5e-143e-4ad5-baf1-e9d94e6cefd1 req-f8313e04-9dc6-4f32-8116-6845252bbd97 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0854723
May 25 16:41:09.717840 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1bdfdd5e-143e-4ad5-baf1-e9d94e6cefd1 req-6a6413f6-81a0-41d0-ba06-a1b5ad894105 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0417228
May 25 16:41:10.597840 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 07e04c0f-8286-42fc-96c2-0e366da529c6 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:41:10.626045 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-85f31ec7-4290-4409-bbad-afb8467ec9b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:10.628705 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-85f31ec7-4290-4409-bbad-afb8467ec9b5 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4&tenant_id=9c4a08443867402386f8ec58d2615739 HTTP/1.1" status: 200  len: 1096 time: 0.0905159
May 25 16:41:10.759288 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-d16710cd-a5a7-4aca-a3c3-1e956d6504a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:10.760844 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-d16710cd-a5a7-4aca-a3c3-1e956d6504a6 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9c4a08443867402386f8ec58d2615739&device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 1096 time: 0.1095715
May 25 16:41:10.968535 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-993f7beb-9eee-4eb4-bb5d-126bb28b2e6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:10.969983 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-993f7beb-9eee-4eb4-bb5d-126bb28b2e6a service neutron] 10.222.0.76 "GET /v2.0/networks?id=b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 200  len: 918 time: 0.2019620
May 25 16:41:10.977978 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d69cf6-9dd5-446e-957d-e271e399bf02 req-7759f9e6-a386-4dc7-9559-d86fc4fa2705 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:10.981424 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-11d69cf6-9dd5-446e-957d-e271e399bf02 req-7759f9e6-a386-4dc7-9559-d86fc4fa2705 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.1379023
May 25 16:41:11.030308 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-11d69cf6-9dd5-446e-957d-e271e399bf02 req-c16e3a83-2fa9-45ee-94d6-d9ef32ee2ad4 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0440776
May 25 16:41:11.177242 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56940) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:11.293570 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f8f8e303-316c-4496-a27d-903df9da934b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:11.308208 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f8f8e303-316c-4496-a27d-903df9da934b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:11.311859 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f8f8e303-316c-4496-a27d-903df9da934b admin admin] Usage tracker for resource:security_group_rule and tenant:cd9fa0e2e1f946a3a98f2ce599a96f05 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:11.314605 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f8f8e303-316c-4496-a27d-903df9da934b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:11.320768 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f8f8e303-316c-4496-a27d-903df9da934b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:11.407143 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f8f8e303-316c-4496-a27d-903df9da934b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:11.411037 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f8f8e303-316c-4496-a27d-903df9da934b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:11.418879 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0a84c563-0b3e-4b91-9fc3-019ca7ec0e12 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:11.458920 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f8f8e303-316c-4496-a27d-903df9da934b admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=cd9fa0e2e1f946a3a98f2ce599a96f05&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2806325
May 25 16:41:11.460483 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8f8e303-316c-4496-a27d-903df9da934b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b00c1bf-1454-4c1f-9fd1-0bc4787e5abf,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:11.461666 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 56946) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:11.463541 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f8f8e303-316c-4496-a27d-903df9da934b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:11.518536 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6ba6af9f-170d-47e3-8baa-61353dd7ce0b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:11.545064 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6ba6af9f-170d-47e3-8baa-61353dd7ce0b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:11.598215 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6ba6af9f-170d-47e3-8baa-61353dd7ce0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:11.602136 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-556cdb4e-1769-4536-aeec-20bd3dee85e4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:11.615253 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ba6af9f-170d-47e3-8baa-61353dd7ce0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b00c1bf-1454-4c1f-9fd1-0bc4787e5abf,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:11.617622 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6ba6af9f-170d-47e3-8baa-61353dd7ce0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:11.621096 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6ba6af9f-170d-47e3-8baa-61353dd7ce0b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:11.622676 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-6ba6af9f-170d-47e3-8baa-61353dd7ce0b admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/3b00c1bf-1454-4c1f-9fd1-0bc4787e5abf HTTP/1.1" status: 204  len: 168 time: 0.1600275
May 25 16:41:11.909732 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-a13ba58d-83e0-4b09-aca0-9a45439cf4d4 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=07e04c0f-8286-42fc-96c2-0e366da529c6 HTTP/1.1" status: 200  len: 999 time: 0.1988828
May 25 16:41:11.929000 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 56956) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:11.946915 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8edee792-8443-46cd-a4b1-c17cbea29195 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:11.961366 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-8edee792-8443-46cd-a4b1-c17cbea29195 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:11.965047 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-8edee792-8443-46cd-a4b1-c17cbea29195 admin admin] Usage tracker for resource:security_group_rule and tenant:cd201e2588394efbaa81e4a428d93eeb is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:11.967833 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-8edee792-8443-46cd-a4b1-c17cbea29195 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:11.973622 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-8edee792-8443-46cd-a4b1-c17cbea29195 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:12.065465 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8edee792-8443-46cd-a4b1-c17cbea29195 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:12.071934 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8edee792-8443-46cd-a4b1-c17cbea29195 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:12.081197 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-23a0c10d-279b-4164-9794-12efa6c39c75 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:12.126504 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8edee792-8443-46cd-a4b1-c17cbea29195 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a140d79-6f22-4f7f-9cdd-d3231a131e07,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:12.134328 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56962) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:12.134541 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-8edee792-8443-46cd-a4b1-c17cbea29195 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=cd201e2588394efbaa81e4a428d93eeb&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2044644
May 25 16:41:12.135424 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-8edee792-8443-46cd-a4b1-c17cbea29195 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:12.202125 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-8d1dea34-6618-4a94-9448-2b33aee24011 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:12.227852 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-8d1dea34-6618-4a94-9448-2b33aee24011 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:12.236471 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e2579d-bd40-495a-a609-cce883dfaa73 req-099ffa4c-ed0c-4198-ad72-ca84765487b8 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:12.238061 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39e2579d-bd40-495a-a609-cce883dfaa73 req-099ffa4c-ed0c-4198-ad72-ca84765487b8 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0830405
May 25 16:41:12.288903 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39e2579d-bd40-495a-a609-cce883dfaa73 req-c5dd10d1-69af-4c1a-be97-3d98625e01f9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0440388
May 25 16:41:12.291015 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-8d1dea34-6618-4a94-9448-2b33aee24011 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:12.296293 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a9a70e75-fe6b-4155-83f8-86410c6029e8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:12.310448 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d1dea34-6618-4a94-9448-2b33aee24011 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a140d79-6f22-4f7f-9cdd-d3231a131e07,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:12.319345 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-8d1dea34-6618-4a94-9448-2b33aee24011 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:12.320617 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-8d1dea34-6618-4a94-9448-2b33aee24011 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:12.324771 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-8d1dea34-6618-4a94-9448-2b33aee24011 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/5a140d79-6f22-4f7f-9cdd-d3231a131e07 HTTP/1.1" status: 204  len: 168 time: 0.1891325
May 25 16:41:12.660276 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-d2bdd262-cb08-4243-9b96-7fec0fea2b17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:12.662452 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-d2bdd262-cb08-4243-9b96-7fec0fea2b17 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=950695d6-8663-4ed4-92fd-b43d8ea5a820 HTTP/1.1" status: 200  len: 856 time: 0.0731754
May 25 16:41:12.680100 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 56972) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:12.697702 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-cb76f212-7158-4f9a-9fb1-b53d7020515f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:12.713731 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-cb76f212-7158-4f9a-9fb1-b53d7020515f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:12.717803 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-cb76f212-7158-4f9a-9fb1-b53d7020515f admin admin] Usage tracker for resource:security_group_rule and tenant:3163a1b5af0b430e8ced92f28324b029 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:12.720668 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-cb76f212-7158-4f9a-9fb1-b53d7020515f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:12.726378 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-cb76f212-7158-4f9a-9fb1-b53d7020515f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:12.810798 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-cb76f212-7158-4f9a-9fb1-b53d7020515f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:12.814878 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-cb76f212-7158-4f9a-9fb1-b53d7020515f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:12.823693 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-1556adc8-a151-49f9-9a94-6620634a46aa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:12.870952 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-cb76f212-7158-4f9a-9fb1-b53d7020515f admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=3163a1b5af0b430e8ced92f28324b029&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1894109
May 25 16:41:12.872965 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb76f212-7158-4f9a-9fb1-b53d7020515f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f06339a-51ab-4795-bba2-769daf588c77,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:12.873898 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 56976) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:12.876230 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-cb76f212-7158-4f9a-9fb1-b53d7020515f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:12.938486 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0e54a653-f905-4d89-a0ee-a084b670988c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:12.964457 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0e54a653-f905-4d89-a0ee-a084b670988c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:13.016840 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0e54a653-f905-4d89-a0ee-a084b670988c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:13.020677 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-bd3f8601-4850-4649-9a74-ec17418f91c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:13.035382 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e54a653-f905-4d89-a0ee-a084b670988c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f06339a-51ab-4795-bba2-769daf588c77,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:13.038262 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0e54a653-f905-4d89-a0ee-a084b670988c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:13.040172 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0e54a653-f905-4d89-a0ee-a084b670988c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:13.043494 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-0e54a653-f905-4d89-a0ee-a084b670988c admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/6f06339a-51ab-4795-bba2-769daf588c77 HTTP/1.1" status: 204  len: 168 time: 0.1664131
May 25 16:41:13.488008 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7239e383-c97d-46eb-b5d2-fe3a1b9066d6 req-5983c93d-79a2-479c-b54f-bcc4f09fe537 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:13.489537 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7239e383-c97d-46eb-b5d2-fe3a1b9066d6 req-5983c93d-79a2-479c-b54f-bcc4f09fe537 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0862288
May 25 16:41:13.535928 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7239e383-c97d-46eb-b5d2-fe3a1b9066d6 req-0a070656-9e7c-4366-be4f-3b1a548df1b8 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405600
May 25 16:41:13.675406 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-f2a4fd65-2ef0-4a34-94a3-c1cd5a38cef4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:13.676916 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-f2a4fd65-2ef0-4a34-94a3-c1cd5a38cef4 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b8cabc9a-0f6f-485c-8020-441b42ac019b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0794995
May 25 16:41:13.823654 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-5a25821a-41f1-4642-9472-8196377357a3 service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1398828
May 25 16:41:13.959504 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6cff7362-aeec-4426-9cad-22d7bbbf0b00 req-789e8b88-a612-4a98-836b-ab9967a17922 service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1286819
May 25 16:41:14.047714 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:14.213705 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57022) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:14.332892 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e069ef7d-919b-46a7-90b6-c5cbc1e4af8c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:14.347715 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-e069ef7d-919b-46a7-90b6-c5cbc1e4af8c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:14.351868 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-e069ef7d-919b-46a7-90b6-c5cbc1e4af8c admin admin] Usage tracker for resource:security_group_rule and tenant:40e0d5d731ab4f61a45175bd32ba3a48 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:14.354738 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-e069ef7d-919b-46a7-90b6-c5cbc1e4af8c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:14.360979 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-e069ef7d-919b-46a7-90b6-c5cbc1e4af8c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:14.443980 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e069ef7d-919b-46a7-90b6-c5cbc1e4af8c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:14.448610 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e069ef7d-919b-46a7-90b6-c5cbc1e4af8c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:14.457091 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-cdc70745-872a-494b-9858-485aa750ab41 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:14.497223 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-e069ef7d-919b-46a7-90b6-c5cbc1e4af8c admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=40e0d5d731ab4f61a45175bd32ba3a48&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2824509
May 25 16:41:14.498147 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e069ef7d-919b-46a7-90b6-c5cbc1e4af8c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=605a11e5-60c8-4595-919c-14bbde9d15d9,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:14.500502 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57034) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:14.501127 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-e069ef7d-919b-46a7-90b6-c5cbc1e4af8c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:14.581897 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-cac4777d-81b4-44c7-8f28-9d0b46c1002c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:14.625958 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-cac4777d-81b4-44c7-8f28-9d0b46c1002c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:14.827523 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-cac4777d-81b4-44c7-8f28-9d0b46c1002c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:14.835966 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:14.855618 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cac4777d-81b4-44c7-8f28-9d0b46c1002c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=605a11e5-60c8-4595-919c-14bbde9d15d9,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:14.863074 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-cac4777d-81b4-44c7-8f28-9d0b46c1002c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:14.872665 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7ed6eda-cad1-4555-a767-0b4dcdc9b2f1 req-e970250e-a979-42dc-845c-89b1f458c962 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:14.874445 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b7ed6eda-cad1-4555-a767-0b4dcdc9b2f1 req-e970250e-a979-42dc-845c-89b1f458c962 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.1952851
May 25 16:41:14.909114 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-cac4777d-81b4-44c7-8f28-9d0b46c1002c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:14.910997 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-cac4777d-81b4-44c7-8f28-9d0b46c1002c admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/605a11e5-60c8-4595-919c-14bbde9d15d9 HTTP/1.1" status: 204  len: 168 time: 0.4080622
May 25 16:41:14.950621 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b7ed6eda-cad1-4555-a767-0b4dcdc9b2f1 req-4bf50f78-4d5f-4a48-b5cd-c4011a58f2a5 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0688081
May 25 16:41:16.192618 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ed2249-d7aa-487e-8b76-7081b5d53f7e req-0f7e469b-74d7-47bb-b2f8-fdd20669537f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:16.194441 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-88ed2249-d7aa-487e-8b76-7081b5d53f7e req-0f7e469b-74d7-47bb-b2f8-fdd20669537f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0868931
May 25 16:41:16.268260 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-88ed2249-d7aa-487e-8b76-7081b5d53f7e req-2fbfc658-e4b5-4401-8412-799392693908 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0611091
May 25 16:41:17.488600 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-870ccde7-6d34-4477-b28e-850343568ab0 req-3cfad0db-f260-4a0f-94ac-eb41fd4650e5 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:17.490311 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-870ccde7-6d34-4477-b28e-850343568ab0 req-3cfad0db-f260-4a0f-94ac-eb41fd4650e5 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0971127
May 25 16:41:17.553960 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-870ccde7-6d34-4477-b28e-850343568ab0 req-381a7896-bf20-4c23-ad86-55d5d6ff201b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0576272
May 25 16:41:18.769819 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38c61d65-e616-462a-8506-4bf7a1a0d725 req-6a7c27a6-24df-489c-8249-5f15e6cec9d4 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:18.772253 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-38c61d65-e616-462a-8506-4bf7a1a0d725 req-6a7c27a6-24df-489c-8249-5f15e6cec9d4 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.1010151
May 25 16:41:18.831783 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-38c61d65-e616-462a-8506-4bf7a1a0d725 req-10ea986a-4c3b-4a02-a579-3273eb92eadb tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0533776
May 25 16:41:18.853702 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57162) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:19.023532 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1c3145e2-0ea8-4fce-baae-570162b608ec admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.039465 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-1c3145e2-0ea8-4fce-baae-570162b608ec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:19.044438 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-1c3145e2-0ea8-4fce-baae-570162b608ec admin admin] Usage tracker for resource:security_group_rule and tenant:30536378d41d40c9aa7c600d50b9cc27 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:19.048024 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-1c3145e2-0ea8-4fce-baae-570162b608ec admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:19.063134 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-1c3145e2-0ea8-4fce-baae-570162b608ec admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:19.164296 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1c3145e2-0ea8-4fce-baae-570162b608ec admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.166066 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57172) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:19.173066 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1c3145e2-0ea8-4fce-baae-570162b608ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.181915 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-24e553f2-8e9a-4316-8126-ae3677df397e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:19.226387 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c3145e2-0ea8-4fce-baae-570162b608ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1512c7df-1aea-4964-82cb-4643b8c66b62,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:19.229749 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-1c3145e2-0ea8-4fce-baae-570162b608ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:19.236566 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-1c3145e2-0ea8-4fce-baae-570162b608ec admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=30536378d41d40c9aa7c600d50b9cc27&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3857970
May 25 16:41:19.237005 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57178) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:19.302816 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3471c699-ddcd-4dea-9d55-5a7fb7a830ac admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.315995 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1e4c7803-24f6-48c9-93b3-3f9b8c67631f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.320499 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-3471c699-ddcd-4dea-9d55-5a7fb7a830ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:19.327574 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-3471c699-ddcd-4dea-9d55-5a7fb7a830ac admin admin] Usage tracker for resource:security_group_rule and tenant:ade133165c2343e98b3ec14f5f66cbd6 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:19.331223 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-3471c699-ddcd-4dea-9d55-5a7fb7a830ac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:19.342392 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-3471c699-ddcd-4dea-9d55-5a7fb7a830ac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:19.346695 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1e4c7803-24f6-48c9-93b3-3f9b8c67631f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.409758 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1e4c7803-24f6-48c9-93b3-3f9b8c67631f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.414452 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ef432725-c74f-4630-988a-7a6d4f786544 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:19.428289 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e4c7803-24f6-48c9-93b3-3f9b8c67631f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1512c7df-1aea-4964-82cb-4643b8c66b62,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:19.435012 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-1e4c7803-24f6-48c9-93b3-3f9b8c67631f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:19.436089 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3471c699-ddcd-4dea-9d55-5a7fb7a830ac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.440683 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1e4c7803-24f6-48c9-93b3-3f9b8c67631f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.441263 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3471c699-ddcd-4dea-9d55-5a7fb7a830ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.444851 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-1e4c7803-24f6-48c9-93b3-3f9b8c67631f admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/1512c7df-1aea-4964-82cb-4643b8c66b62 HTTP/1.1" status: 204  len: 168 time: 0.2042375
May 25 16:41:19.458657 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b89759d1-453f-4650-b96c-a7d07642f36d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:19.490080 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3471c699-ddcd-4dea-9d55-5a7fb7a830ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b04f760-827a-4fc3-865d-4a6824dfb4ed,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:19.494456 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3471c699-ddcd-4dea-9d55-5a7fb7a830ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:19.513442 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-3471c699-ddcd-4dea-9d55-5a7fb7a830ac admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=ade133165c2343e98b3ec14f5f66cbd6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3441210
May 25 16:41:19.514205 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57184) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:19.579476 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-58c3d329-63ce-498e-85fd-86941a0f6878 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.609368 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-58c3d329-63ce-498e-85fd-86941a0f6878 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.670064 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-58c3d329-63ce-498e-85fd-86941a0f6878 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.675268 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9fb2d50e-a5f3-456e-bf95-f27fabedf284 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:19.694813 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58c3d329-63ce-498e-85fd-86941a0f6878 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b04f760-827a-4fc3-865d-4a6824dfb4ed,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:19.698516 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-58c3d329-63ce-498e-85fd-86941a0f6878 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:19.700882 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-58c3d329-63ce-498e-85fd-86941a0f6878 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.702154 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-58c3d329-63ce-498e-85fd-86941a0f6878 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/2b04f760-827a-4fc3-865d-4a6824dfb4ed HTTP/1.1" status: 204  len: 168 time: 0.1869876
May 25 16:41:19.803019 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57192) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:19.834520 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2836a0d8-2b34-43a3-960e-2ab0ec109347 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.850349 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-2836a0d8-2b34-43a3-960e-2ab0ec109347 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:19.854772 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-2836a0d8-2b34-43a3-960e-2ab0ec109347 admin admin] Usage tracker for resource:security_group_rule and tenant:0dfb4df135984ec28f97433205eaa50c is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:19.857914 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-2836a0d8-2b34-43a3-960e-2ab0ec109347 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:19.866978 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-2836a0d8-2b34-43a3-960e-2ab0ec109347 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:19.978750 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2836a0d8-2b34-43a3-960e-2ab0ec109347 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.984265 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2836a0d8-2b34-43a3-960e-2ab0ec109347 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:19.994133 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-48a8f9f4-bb02-44a4-ab25-ca21ba446884 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:20.058093 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-2836a0d8-2b34-43a3-960e-2ab0ec109347 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=0dfb4df135984ec28f97433205eaa50c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2538023
May 25 16:41:20.060012 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57202) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:20.063350 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf2ecde-4e4b-4fb2-9f24-9d1c6d83d25c req-1f6a1bb2-b7b9-43ef-9f3c-cf62fe691e07 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:20.064285 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2836a0d8-2b34-43a3-960e-2ab0ec109347 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a37de19-fe0a-49a6-b1fc-992577d8e273,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:20.065295 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7bf2ecde-4e4b-4fb2-9f24-9d1c6d83d25c req-1f6a1bb2-b7b9-43ef-9f3c-cf62fe691e07 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0941601
May 25 16:41:20.099574 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2836a0d8-2b34-43a3-960e-2ab0ec109347 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:20.128798 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7bf2ecde-4e4b-4fb2-9f24-9d1c6d83d25c req-081b1eff-0ab5-4876-872f-69134fda8303 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0490248
May 25 16:41:20.156600 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-4ef6280c-fb08-4e43-a9fa-71b0889f2732 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:20.189857 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-4ef6280c-fb08-4e43-a9fa-71b0889f2732 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:20.254962 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-4ef6280c-fb08-4e43-a9fa-71b0889f2732 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:20.260461 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-39194e1c-a710-41d3-9d0d-57aa0f0fa493 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:20.279035 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ef6280c-fb08-4e43-a9fa-71b0889f2732 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a37de19-fe0a-49a6-b1fc-992577d8e273,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:20.281866 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-4ef6280c-fb08-4e43-a9fa-71b0889f2732 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:20.294879 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-4ef6280c-fb08-4e43-a9fa-71b0889f2732 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:20.297494 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-4ef6280c-fb08-4e43-a9fa-71b0889f2732 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/9a37de19-fe0a-49a6-b1fc-992577d8e273 HTTP/1.1" status: 204  len: 168 time: 0.2349160
May 25 16:41:21.393886 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e789afc4-d037-4dea-8105-7875c52f7497 req-feeba255-07fb-4dc0-9b28-bc328306fbf5 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:21.396040 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e789afc4-d037-4dea-8105-7875c52f7497 req-feeba255-07fb-4dc0-9b28-bc328306fbf5 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.1171060
May 25 16:41:21.467653 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e789afc4-d037-4dea-8105-7875c52f7497 req-20fe4fb9-56b5-475c-bbfb-f471478e2fb6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0618613
May 25 16:41:22.725330 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00b7cd6c-4480-403c-8e18-a3f73cb38bcd req-b89f25c1-4ee6-4240-a92a-0b7ca520419d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:22.727225 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-00b7cd6c-4480-403c-8e18-a3f73cb38bcd req-b89f25c1-4ee6-4240-a92a-0b7ca520419d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.1093612
May 25 16:41:22.783400 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-00b7cd6c-4480-403c-8e18-a3f73cb38bcd req-5f43c33a-c8ab-446f-8485-8ba649847434 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0499465
May 25 16:41:24.197649 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b252eff-05c3-44c5-acbe-8f2084f795bf req-b0c324d1-23b4-4386-a4f4-cb3d6b61d5bb tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:24.202158 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8b252eff-05c3-44c5-acbe-8f2084f795bf req-b0c324d1-23b4-4386-a4f4-cb3d6b61d5bb tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0867827
May 25 16:41:24.251773 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8b252eff-05c3-44c5-acbe-8f2084f795bf req-ec94e33a-b52a-4e59-8815-8d4073d6ad8b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0413091
May 25 16:41:25.492859 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2495534e-781d-406a-a7b9-4ab2a3c9a84b req-32ad6379-3337-46c7-bf42-f94b5fffeee7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:25.494749 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2495534e-781d-406a-a7b9-4ab2a3c9a84b req-32ad6379-3337-46c7-bf42-f94b5fffeee7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0894320
May 25 16:41:25.563776 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2495534e-781d-406a-a7b9-4ab2a3c9a84b req-c01cd92d-7d08-4ec8-aee1-57ff4f1513d7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0569577
May 25 16:41:26.837254 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b543e1d4-9f52-4532-9949-a1615101a1fd req-dd411c18-1f3f-4b0c-a342-47c215fbc244 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:26.838732 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b543e1d4-9f52-4532-9949-a1615101a1fd req-dd411c18-1f3f-4b0c-a342-47c215fbc244 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.1597059
May 25 16:41:26.885301 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b543e1d4-9f52-4532-9949-a1615101a1fd req-deb69050-46fe-45cb-848c-72deb6d6b9d8 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0410736
May 25 16:41:28.077630 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-febf3b2f-104a-4f38-a8b2-567fcb40cb95 req-29f54c95-cd79-4df4-a8ca-16a580aae1aa tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:28.079056 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-febf3b2f-104a-4f38-a8b2-567fcb40cb95 req-29f54c95-cd79-4df4-a8ca-16a580aae1aa tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0827332
May 25 16:41:28.125455 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-febf3b2f-104a-4f38-a8b2-567fcb40cb95 req-7f395ca3-d227-46fb-83af-8285ba61545c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402360
May 25 16:41:29.312848 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b414254b-062a-44c2-8761-39b25a6ecfd8 req-86db6950-9a0a-4282-b6c2-68718ef1dad7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:29.314332 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b414254b-062a-44c2-8761-39b25a6ecfd8 req-86db6950-9a0a-4282-b6c2-68718ef1dad7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0808506
May 25 16:41:29.361198 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b414254b-062a-44c2-8761-39b25a6ecfd8 req-e7bb753f-b33f-4084-b840-6492a44c8b1d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412474
May 25 16:41:30.502400 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:41:30.552187 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a1233e5-8e09-462e-882a-2b501cbb8414 req-472842db-1bab-45db-8f7c-72ac214a88b2 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:30.553625 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4a1233e5-8e09-462e-882a-2b501cbb8414 req-472842db-1bab-45db-8f7c-72ac214a88b2 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0787189
May 25 16:41:30.600708 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4a1233e5-8e09-462e-882a-2b501cbb8414 req-eacb327c-36a9-4b25-ad0c-24b5505201c4 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0408826
May 25 16:41:31.419534 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4e206ce7-4a6c-4c29-b457-9ff309953578 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:31.799876 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01395bcd-aef8-4bfb-8730-5133b0f614fc req-de99dc5a-3f2d-4314-998d-3e8d82c9c8cf tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:31.801335 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-01395bcd-aef8-4bfb-8730-5133b0f614fc req-de99dc5a-3f2d-4314-998d-3e8d82c9c8cf tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0894396
May 25 16:41:31.845437 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-01395bcd-aef8-4bfb-8730-5133b0f614fc req-c1b2c3ca-e430-4f14-93f0-c2effdcab139 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0380564
May 25 16:41:33.058978 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86eb4b49-d22d-496d-b2fb-1bd2b3be952a req-471cfb67-dfec-426d-a8ca-093d0a38c19e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:33.060573 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-86eb4b49-d22d-496d-b2fb-1bd2b3be952a req-471cfb67-dfec-426d-a8ca-093d0a38c19e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.1006780
May 25 16:41:33.112917 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-86eb4b49-d22d-496d-b2fb-1bd2b3be952a req-219c9301-b844-4995-9781-a85205e6e5e5 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0457714
May 25 16:41:33.840047 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:34.115230 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-ad151e22-cff1-41f9-9f13-161bc1e7eb8a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:34.311590 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dd211a5-4106-4771-b333-9e7494c78327 req-dd1baf43-46df-4de9-8f8d-7bc7e2d202c3 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:34.313200 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8dd211a5-4106-4771-b333-9e7494c78327 req-dd1baf43-46df-4de9-8f8d-7bc7e2d202c3 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 943 time: 0.0901916
May 25 16:41:34.362137 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8dd211a5-4106-4771-b333-9e7494c78327 req-692bf5e3-d784-4bbb-913a-f627c239bf2c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0423572
May 25 16:41:34.723834 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 07e04c0f-8286-42fc-96c2-0e366da529c6 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:41:34.885689 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 07e04c0f-8286-42fc-96c2-0e366da529c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=07e04c0f-8286-42fc-96c2-0e366da529c6,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:41:34.899057 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'port_id': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'mac_address': 'fa:16:3e:09:7e:45', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 414, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:41:34.952432 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:34.972427 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 07e04c0f-8286-42fc-96c2-0e366da529c6 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:41:34.988417 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 07e04c0f-8286-42fc-96c2-0e366da529c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=07e04c0f-8286-42fc-96c2-0e366da529c6,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:41:34.993083 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:34.997051 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:35.071829 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:35.075344 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=07e04c0f-8286-42fc-96c2-0e366da529c6,revision_number=9']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:35.083367 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:35.083716 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:35.084040 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:35.084364 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:35.084686 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:35.085011 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:35.085324 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:35.085680 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:35.086015 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:35.086333 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:35.086646 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:35.086961 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:35.104082 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:35.242951 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['07e04c0f-8286-42fc-96c2-0e366da529c6'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:41:35.558822 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed41fbe-1f07-47cd-a761-af927dcdae28 req-49ddfc03-6672-45b4-bdfa-4ac1a4ce3dad tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:35.560369 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9ed41fbe-1f07-47cd-a761-af927dcdae28 req-49ddfc03-6672-45b4-bdfa-4ac1a4ce3dad tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 944 time: 0.0839834
May 25 16:41:35.606020 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9ed41fbe-1f07-47cd-a761-af927dcdae28 req-e0f3e97c-fb06-40b7-8a12-2cdc2e41f320 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399041
May 25 16:41:36.562825 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:36.739586 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 07e04c0f-8286-42fc-96c2-0e366da529c6 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:41:36.803357 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0982924-e07d-4c24-9caf-ce3a299c3f49 req-dcfb5424-6572-41b6-9c52-2e18778bc71d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:36.804714 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e0982924-e07d-4c24-9caf-ce3a299c3f49 req-dcfb5424-6572-41b6-9c52-2e18778bc71d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 944 time: 0.0833652
May 25 16:41:36.809175 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 07e04c0f-8286-42fc-96c2-0e366da529c6 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:41:36.809175 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:36.855401 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e0982924-e07d-4c24-9caf-ce3a299c3f49 req-c502c5c5-e995-4677-b5ea-edbf5cf72492 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0427496
May 25 16:41:36.939438 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:36.968689 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:41:36.979075 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 07e04c0f-8286-42fc-96c2-0e366da529c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=07e04c0f-8286-42fc-96c2-0e366da529c6,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:41:36.984500 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:36.986623 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:37.039037 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'code': 200}
May 25 16:41:37.078856 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=07e04c0f-8286-42fc-96c2-0e366da529c6,revision_number=10']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:37.082079 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:37.595009 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d76bbebe-7f78-4451-9ca2-47084c546b37 req-d85d0f7c-cec0-4f35-bd1d-6ee4dc789107 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:37.596375 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d76bbebe-7f78-4451-9ca2-47084c546b37 req-d85d0f7c-cec0-4f35-bd1d-6ee4dc789107 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 1099 time: 0.0704846
May 25 16:41:37.643383 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d76bbebe-7f78-4451-9ca2-47084c546b37 req-fb7a767a-6835-4a0c-a860-c5fbb057ea4d service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0376084
May 25 16:41:38.054104 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea06c2c3-bb71-4b2a-a24d-9def9c0f86fb req-f3829401-1f33-450a-903c-3b547f106c44 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:38.055897 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ea06c2c3-bb71-4b2a-a24d-9def9c0f86fb req-f3829401-1f33-450a-903c-3b547f106c44 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 946 time: 0.0808296
May 25 16:41:38.105416 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ea06c2c3-bb71-4b2a-a24d-9def9c0f86fb req-9c64d604-8104-430f-b047-600d81177a7e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0420942
May 25 16:41:39.360227 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-427554fa-1c1d-43c4-92a0-7f11a6f80abd req-6cfa6ccf-c91d-46ed-b551-f2be1c06cade tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:39.361883 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-427554fa-1c1d-43c4-92a0-7f11a6f80abd req-6cfa6ccf-c91d-46ed-b551-f2be1c06cade tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 946 time: 0.1060596
May 25 16:41:39.417647 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-427554fa-1c1d-43c4-92a0-7f11a6f80abd req-9d08131b-2dbe-454f-ad97-6e7df01d430c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0491045
May 25 16:41:39.425797 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57608) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:39.571925 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:39.587527 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:39.591278 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Usage tracker for resource:security_group_rule and tenant:79ceb28b29d94916a89e40da510e959c is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:39.594187 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:39.601033 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:39.686830 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:39.691736 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:39.700300 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7eb77fa8-1c7e-46a1-b678-cead77c5c194 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:39.739627 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=41c40d45-ea89-458c-a83c-56c8428e2195,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:39.743428 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=79ceb28b29d94916a89e40da510e959c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3163855
May 25 16:41:39.746501 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57614) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:39.749689 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.750067 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.750511 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.750875 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.751236 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.751606 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.751953 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.752300 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.752671 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.753040 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.753388 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.754243 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.758160 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:39.808781 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:39.835159 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:39.892587 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:39.896823 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:39.907831 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=41c40d45-ea89-458c-a83c-56c8428e2195,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:39.917651 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:39.918745 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/41c40d45-ea89-458c-a83c-56c8428e2195 HTTP/1.1" status: 204  len: 168 time: 0.1712892
May 25 16:41:39.920306 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.920666 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.921020 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.921366 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.921735 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.922080 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.922420 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.923020 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.923115 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.923406 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.923739 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.924072 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:41:39.927773 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-8fc461cd-102f-42d8-bd5d-0ea9fdca5de7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:40.202084 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57622) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:40.219927 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-70823a83-4b1d-4b47-ba6d-e792fd04e5cc admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:40.236986 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-70823a83-4b1d-4b47-ba6d-e792fd04e5cc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:40.241568 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-70823a83-4b1d-4b47-ba6d-e792fd04e5cc admin admin] Usage tracker for resource:security_group_rule and tenant:16b1240dbe9b413ca438ebdee65292ec is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:40.244300 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-70823a83-4b1d-4b47-ba6d-e792fd04e5cc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:40.250060 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-70823a83-4b1d-4b47-ba6d-e792fd04e5cc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:40.332056 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-70823a83-4b1d-4b47-ba6d-e792fd04e5cc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:40.335758 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-70823a83-4b1d-4b47-ba6d-e792fd04e5cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:40.343383 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-98fffef9-6b79-4629-b89d-b91b078f1fab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:40.382998 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70823a83-4b1d-4b47-ba6d-e792fd04e5cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c7f4beb-5a48-42ef-81d9-a400dffc87d6,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:40.386534 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-70823a83-4b1d-4b47-ba6d-e792fd04e5cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:40.389057 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-70823a83-4b1d-4b47-ba6d-e792fd04e5cc admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=16b1240dbe9b413ca438ebdee65292ec&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1859753
May 25 16:41:40.391640 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57626) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:40.449970 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6f1295fc-5583-4389-ad2a-c0138b3fbea7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:40.476190 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6f1295fc-5583-4389-ad2a-c0138b3fbea7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:40.527816 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6f1295fc-5583-4389-ad2a-c0138b3fbea7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:40.531909 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-871e07df-4a4d-4ce2-abbb-72e132606e41 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:40.548570 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f1295fc-5583-4389-ad2a-c0138b3fbea7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c7f4beb-5a48-42ef-81d9-a400dffc87d6,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:40.552245 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6f1295fc-5583-4389-ad2a-c0138b3fbea7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:40.604726 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6f1295fc-5583-4389-ad2a-c0138b3fbea7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:40.605991 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-6f1295fc-5583-4389-ad2a-c0138b3fbea7 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/2c7f4beb-5a48-42ef-81d9-a400dffc87d6 HTTP/1.1" status: 204  len: 168 time: 0.2132883
May 25 16:41:40.649350 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-836f95d2-19c7-42ee-a63a-0dece0685be8 req-fb591393-ef24-493c-882b-0ea2b30d8a86 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:40.650868 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-836f95d2-19c7-42ee-a63a-0dece0685be8 req-fb591393-ef24-493c-882b-0ea2b30d8a86 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 946 time: 0.1038263
May 25 16:41:40.697181 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-836f95d2-19c7-42ee-a63a-0dece0685be8 req-1423b688-eb5e-4193-97e1-6c79afa0a22a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406430
May 25 16:41:42.496524 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57704) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:42.621485 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9499aab2-3af4-4d2a-b886-fb47ccc0c567 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:42.636084 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9499aab2-3af4-4d2a-b886-fb47ccc0c567 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:42.639832 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9499aab2-3af4-4d2a-b886-fb47ccc0c567 admin admin] Usage tracker for resource:security_group_rule and tenant:11aadc89258140dab9d15c2cae3ba46c is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:42.642674 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9499aab2-3af4-4d2a-b886-fb47ccc0c567 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:42.648636 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9499aab2-3af4-4d2a-b886-fb47ccc0c567 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:42.734752 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9499aab2-3af4-4d2a-b886-fb47ccc0c567 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:42.739644 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9499aab2-3af4-4d2a-b886-fb47ccc0c567 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:42.746014 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-fe4af097-7970-48c1-a65e-57e0c3d3e0fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:42.790554 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-9499aab2-3af4-4d2a-b886-fb47ccc0c567 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=11aadc89258140dab9d15c2cae3ba46c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2929645
May 25 16:41:42.791465 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9499aab2-3af4-4d2a-b886-fb47ccc0c567 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e1fac5cb-dc14-432e-9ede-b5d1afdb8db5,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:42.793684 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57710) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:42.794842 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9499aab2-3af4-4d2a-b886-fb47ccc0c567 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:42.856147 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-df160422-5614-45f6-857f-44c71e07540d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:42.881505 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-df160422-5614-45f6-857f-44c71e07540d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:42.933811 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-df160422-5614-45f6-857f-44c71e07540d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:42.937576 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3471c699-ddcd-4dea-9d55-5a7fb7a830ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:42.950150 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df160422-5614-45f6-857f-44c71e07540d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e1fac5cb-dc14-432e-9ede-b5d1afdb8db5,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:42.954997 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-df160422-5614-45f6-857f-44c71e07540d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:42.959411 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-df160422-5614-45f6-857f-44c71e07540d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:42.960526 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-df160422-5614-45f6-857f-44c71e07540d admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/e1fac5cb-dc14-432e-9ede-b5d1afdb8db5 HTTP/1.1" status: 204  len: 168 time: 0.1658759
May 25 16:41:43.241916 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57718) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:43.259589 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ecb0be0f-43dd-4c8b-920d-da5206d420de admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:43.274388 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-ecb0be0f-43dd-4c8b-920d-da5206d420de admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:43.278661 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-ecb0be0f-43dd-4c8b-920d-da5206d420de admin admin] Usage tracker for resource:security_group_rule and tenant:be0afee83e8f47b7b1acb494a7aa7b6c is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:43.281457 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-ecb0be0f-43dd-4c8b-920d-da5206d420de admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:43.287713 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-ecb0be0f-43dd-4c8b-920d-da5206d420de admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:43.370949 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ecb0be0f-43dd-4c8b-920d-da5206d420de admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:43.375873 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ecb0be0f-43dd-4c8b-920d-da5206d420de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:43.382783 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-aeb20792-0f3a-41ea-8263-be572eaa83bb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:43.426784 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-ecb0be0f-43dd-4c8b-920d-da5206d420de admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=be0afee83e8f47b7b1acb494a7aa7b6c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1838250
May 25 16:41:43.427768 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecb0be0f-43dd-4c8b-920d-da5206d420de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d731498-0564-44cd-a564-d2eeefc90cb4,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:43.429555 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57722) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:43.431187 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ecb0be0f-43dd-4c8b-920d-da5206d420de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:43.490715 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6183b1ab-cea7-4a41-9219-1da149a6265e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:43.515944 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6183b1ab-cea7-4a41-9219-1da149a6265e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:43.570779 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6183b1ab-cea7-4a41-9219-1da149a6265e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:43.574754 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6ba6af9f-170d-47e3-8baa-61353dd7ce0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:43.588160 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6183b1ab-cea7-4a41-9219-1da149a6265e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d731498-0564-44cd-a564-d2eeefc90cb4,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:43.591914 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6183b1ab-cea7-4a41-9219-1da149a6265e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:43.597445 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6183b1ab-cea7-4a41-9219-1da149a6265e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:43.598576 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-6183b1ab-cea7-4a41-9219-1da149a6265e admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/9d731498-0564-44cd-a564-d2eeefc90cb4 HTTP/1.1" status: 204  len: 168 time: 0.1669307
May 25 16:41:44.040657 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:49.066523 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf5eef83-7645-4d91-bcfd-2c911198edb5 req-531f61c5-23b0-492b-b94a-3bbcd251167b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:49.067969 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cf5eef83-7645-4d91-bcfd-2c911198edb5 req-531f61c5-23b0-492b-b94a-3bbcd251167b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.1488404
May 25 16:41:49.114511 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cf5eef83-7645-4d91-bcfd-2c911198edb5 req-5a5cd568-97c6-4bd8-8c4c-60f6e710093c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0403531
May 25 16:41:50.307597 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb109875-f7c0-4708-a38c-adcc0db8ed4e req-6fd39a14-38e4-4009-abdd-cf10574cbe32 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:50.309144 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bb109875-f7c0-4708-a38c-adcc0db8ed4e req-6fd39a14-38e4-4009-abdd-cf10574cbe32 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0868015
May 25 16:41:50.356846 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bb109875-f7c0-4708-a38c-adcc0db8ed4e req-467f3ccb-2459-4b84-8b9c-315a035a2123 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419817
May 25 16:41:51.542542 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a36b6ff-886f-4122-bf90-960ccc2d4725 req-d0628f6b-96fb-42dc-8996-82bcd084f2d5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:51.543995 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1a36b6ff-886f-4122-bf90-960ccc2d4725 req-d0628f6b-96fb-42dc-8996-82bcd084f2d5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0795178
May 25 16:41:51.591189 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1a36b6ff-886f-4122-bf90-960ccc2d4725 req-44769f23-e858-4282-8af0-b3f63baf5cc6 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414877
May 25 16:41:52.798342 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db72aafd-9de2-4b91-868a-73d48c06d47a req-4c8120c2-cb1e-44a6-bd4c-d71e15afbed6 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:52.799761 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-db72aafd-9de2-4b91-868a-73d48c06d47a req-4c8120c2-cb1e-44a6-bd4c-d71e15afbed6 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0861602
May 25 16:41:52.843464 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-db72aafd-9de2-4b91-868a-73d48c06d47a req-40259287-857e-4b3e-ac04-b19e3f5175ee tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377626
May 25 16:41:54.031118 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd755ad-7057-4371-979b-a01017544c13 req-1024d817-013e-44a2-83c4-f6b959d14df3 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:54.032542 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-acd755ad-7057-4371-979b-a01017544c13 req-1024d817-013e-44a2-83c4-f6b959d14df3 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0853779
May 25 16:41:54.077164 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-acd755ad-7057-4371-979b-a01017544c13 req-4bd92629-ca84-4317-97c5-5bc15f0db7a2 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=b257116c-be87-401f-9cd7-142eb1c0353f&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389245
May 25 16:41:54.395622 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-1a47b782-2af6-4804-9f39-a2cb4795f889 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:54.397055 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-1a47b782-2af6-4804-9f39-a2cb4795f889 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.76 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 945 time: 0.0929904
May 25 16:41:54.530528 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Deleting port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:41:54.530864 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:54.680816 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] For port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=2b1a8c74-03d6-4f98-a405-94fc04b50dd4,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:41:54.681081 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:54.981695 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:54.982049 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:54.982351 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.l3_db [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Floating IP 80824522-0cb3-4434-95a1-3f1521830e9f disassociated. External IP: 172.27.3.254, port: 2b1a8c74-03d6-4f98-a405-94fc04b50dd4.
May 25 16:41:54.982725 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Calling delete_port for 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:41:55.124311 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:55.132255 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:55.178068 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event deleted for resources: {'Port': ['ID=2b1a8c74-03d6-4f98-a405-94fc04b50dd4,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:55.181382 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:55.288934 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3dd1e93b-40b2-4a8f-966d-64bc35936ee1 req-a56c158b-3cd4-499a-a1fc-eae8130db530 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 210 time: 0.1020806
May 25 16:41:55.441874 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Router d0ffdac8-c8d7-4bac-8f41-858898f1783d has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:41:55.711369 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:41:55.721948 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03d7d539-7a87-4887-959e-ec572ec22c5a None None] Sync routers for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:41:55.734092 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03d7d539-7a87-4887-959e-ec572ec22c5a None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:41:55.735160 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-03d7d539-7a87-4887-959e-ec572ec22c5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b786ac0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:41:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:41:55.787688 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] No DVR routers for this DVR port 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:41:55.790533 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:55.793888 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ef73ba0e-8188-4e52-b28a-c1e8e3967a4f', 'name': 'network-vif-deleted', 'tag': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:41:55.810316 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f52eb2d5-9fbb-45a8-8774-d274afe60774 req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.76 "DELETE /v2.0/ports/2b1a8c74-03d6-4f98-a405-94fc04b50dd4 HTTP/1.1" status: 204  len: 173 time: 1.4077060
May 25 16:41:55.843507 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ef73ba0e-8188-4e52-b28a-c1e8e3967a4f', 'name': 'network-vif-deleted', 'tag': '2b1a8c74-03d6-4f98-a405-94fc04b50dd4', 'status': 'completed', 'code': 200}
May 25 16:41:55.922789 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-03d7d539-7a87-4887-959e-ec572ec22c5a None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:41:56.318608 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-03d7d539-7a87-4887-959e-ec572ec22c5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b786ac0>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:41Z', 'revision_number': 5, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:41:56.324521 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03d7d539-7a87-4887-959e-ec572ec22c5a None None] Checking router: d0ffdac8-c8d7-4bac-8f41-858898f1783d for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:41:56.337509 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03d7d539-7a87-4887-959e-ec572ec22c5a None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:41:56.338187 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-03d7d539-7a87-4887-959e-ec572ec22c5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b786ac0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:41:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:41:56.520751 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-acbdbe74-a8aa-4cc9-92cb-c057e89e9aaf req-69e2a557-a2c7-4cc7-bab4-8b2ee6ed47d3 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Synchronizing usage tracker for tenant:63f896ab0d7e44158204551033c33ba4 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:41:56.549697 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-acbdbe74-a8aa-4cc9-92cb-c057e89e9aaf req-69e2a557-a2c7-4cc7-bab4-8b2ee6ed47d3 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Unset dirty status for tenant:63f896ab0d7e44158204551033c33ba4 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:41:56.561374 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-acbdbe74-a8aa-4cc9-92cb-c057e89e9aaf req-69e2a557-a2c7-4cc7-bab4-8b2ee6ed47d3 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=ef73ba0e-8188-4e52-b28a-c1e8e3967a4f HTTP/1.1" status: 200  len: 210 time: 0.1097310
May 25 16:41:56.654470 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-03d7d539-7a87-4887-959e-ec572ec22c5a None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:41:56.669221 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57862) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:56.832928 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:41:56.874550 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-77d11e07-ee8d-40b4-a322-946ef0fde79f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:56.877250 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:41:56.877616 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 2b1a8c74-03d6-4f98-a405-94fc04b50dd4 not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:41:56.890849 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-77d11e07-ee8d-40b4-a322-946ef0fde79f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:56.895188 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-77d11e07-ee8d-40b4-a322-946ef0fde79f admin admin] Usage tracker for resource:security_group_rule and tenant:cf590a773a6f4a7b9ab458c82abb3bed is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:56.898243 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-77d11e07-ee8d-40b4-a322-946ef0fde79f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:56.903950 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-77d11e07-ee8d-40b4-a322-946ef0fde79f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:56.989335 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-77d11e07-ee8d-40b4-a322-946ef0fde79f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:56.994029 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-77d11e07-ee8d-40b4-a322-946ef0fde79f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:57.002744 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-18a046d1-06a6-4eec-a097-c58bcbda9b31 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:57.036138 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-77d11e07-ee8d-40b4-a322-946ef0fde79f admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=cf590a773a6f4a7b9ab458c82abb3bed&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3631771
May 25 16:41:57.036499 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57872) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:57.049088 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77d11e07-ee8d-40b4-a322-946ef0fde79f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22e0154c-712d-47fd-b2e6-b47eb3148fec,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:57.052926 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-77d11e07-ee8d-40b4-a322-946ef0fde79f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:57.085536 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-03d7d539-7a87-4887-959e-ec572ec22c5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b786ac0>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:41Z', 'revision_number': 5, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:41:57.089893 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03d7d539-7a87-4887-959e-ec572ec22c5a None None] The sync data for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi is: [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:41Z', 'revision_number': 5, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:41:57.111935 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3cfdf3bb-aa4c-482c-9163-7216ea8e62b0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:57.141288 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3cfdf3bb-aa4c-482c-9163-7216ea8e62b0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:57.196481 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3cfdf3bb-aa4c-482c-9163-7216ea8e62b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:57.200980 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d9cf5519-c02e-4796-b525-39a7a2efae04 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:57.216186 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cfdf3bb-aa4c-482c-9163-7216ea8e62b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22e0154c-712d-47fd-b2e6-b47eb3148fec,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:57.220182 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-3cfdf3bb-aa4c-482c-9163-7216ea8e62b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:57.223569 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3cfdf3bb-aa4c-482c-9163-7216ea8e62b0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:57.225061 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-3cfdf3bb-aa4c-482c-9163-7216ea8e62b0 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/22e0154c-712d-47fd-b2e6-b47eb3148fec HTTP/1.1" status: 204  len: 168 time: 0.1874237
May 25 16:41:57.366405 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0505c769-49e6-410e-944f-52eaf376e212 None None] New status for floating IP 80824522-0cb3-4434-95a1-3f1521830e9f: DOWN {{(pid=92015) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:41:57.695917 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57892) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:57.770427 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f3f1c49d-8e2e-4804-bb4e-ea7c899ce0d5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:57.802076 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f3f1c49d-8e2e-4804-bb4e-ea7c899ce0d5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:57.958377 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f3f1c49d-8e2e-4804-bb4e-ea7c899ce0d5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:57.963658 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-df160422-5614-45f6-857f-44c71e07540d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:57.982759 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3f1c49d-8e2e-4804-bb4e-ea7c899ce0d5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b257116c-be87-401f-9cd7-142eb1c0353f,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:57.986164 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f3f1c49d-8e2e-4804-bb4e-ea7c899ce0d5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:58.018319 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f3f1c49d-8e2e-4804-bb4e-ea7c899ce0d5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.020137 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f3f1c49d-8e2e-4804-bb4e-ea7c899ce0d5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "DELETE /v2.0/security-groups/b257116c-be87-401f-9cd7-142eb1c0353f HTTP/1.1" status: 204  len: 168 time: 0.3226326
May 25 16:41:58.022755 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57908) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:58.041469 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.api.v2.resource [None req-620da8c6-97ab-4bac-986d-99ed3a9a5535 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] show failed (client error): The resource could not be found.
May 25 16:41:58.044989 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-620da8c6-97ab-4bac-986d-99ed3a9a5535 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups/b257116c-be87-401f-9cd7-142eb1c0353f HTTP/1.1" status: 404  len: 347 time: 0.0187080
May 25 16:41:58.045293 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57912) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:58.055791 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57916) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:58.188641 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1543553477-network', 'tenant_id': '577d706beb414387a68972cf7e8d0285'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:41:58.196603 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:58.200916 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Usage tracker for resource:network and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:58.204044 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:58.210801 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:58.227805 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Made reservation on behalf of 577d706beb414387a68972cf7e8d0285 for: {'network': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:41:58.230685 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.244708 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.261466 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:58.265738 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Usage tracker for resource:security_group_rule and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:58.268647 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:58.275553 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:58.309579 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-7bf0bc36-6007-49d7-90a4-70f7103490a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Deleting port 3cff790e-1327-438f-afcc-8b654a7a28db {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:41:58.309956 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7bf0bc36-6007-49d7-90a4-70f7103490a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.371590 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.375834 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.380474 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-f5df4721-660e-48de-87fc-f8dc43fcb34b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:58.407640 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 435}  {{(pid=92013) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:41:58.416781 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed3ec06a-958a-41e2-9a95-bb80ff2e72fe,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:58.420415 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:58.423211 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.423560 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.segments_db [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Added segment 6f90d03f-b69f-445e-ac5f-91537c20f661 of type vlan for network 9c8cc949-bd51-40a0-bff3-5527e7341361
May 25 16:41:58.437577 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7bf0bc36-6007-49d7-90a4-70f7103490a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.437904 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7bf0bc36-6007-49d7-90a4-70f7103490a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.451622 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.482523 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.483977 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:58.484705 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.488824 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:58.569601 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-7bf0bc36-6007-49d7-90a4-70f7103490a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Calling delete_port for 3cff790e-1327-438f-afcc-8b654a7a28db owned by network:floatingip {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:41:58.588216 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Pushing event updated for resources: {'Network': ['ID=9c8cc949-bd51-40a0-bff3-5527e7341361,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:58.594193 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.5346136
May 25 16:41:58.594193 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:58.594923 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57924) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:58.599808 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network 9c8cc949-bd51-40a0-bff3-5527e7341361 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:41:58.601712 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Request body: {'subnet': {'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1543553477-subnet', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'ip_version': 4}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:41:58.607846 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:58.614045 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Usage tracker for resource:subnet and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:58.617748 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:58.625472 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:58.646859 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Made reservation on behalf of 577d706beb414387a68972cf7e8d0285 for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:41:58.649441 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-697612'] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.822642 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7bf0bc36-6007-49d7-90a4-70f7103490a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:58.828156 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b30e159c-eb74-48b5-97f1-e68fbebdcad3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:58.875102 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf0bc36-6007-49d7-90a4-70f7103490a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event deleted for resources: {'Port': ['ID=3cff790e-1327-438f-afcc-8b654a7a28db,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:58.878011 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7bf0bc36-6007-49d7-90a4-70f7103490a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:59.030700 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7bf0bc36-6007-49d7-90a4-70f7103490a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.135317 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7bf0bc36-6007-49d7-90a4-70f7103490a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.136459 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-7bf0bc36-6007-49d7-90a4-70f7103490a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "DELETE /v2.0/floatingips/80824522-0cb3-4434-95a1-3f1521830e9f HTTP/1.1" status: 204  len: 168 time: 1.0902567
May 25 16:41:59.271405 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7721570', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-697626'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.275197 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:59.350566 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2f2f7850-0dc5-48dc-8602-816147b64784,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:59.356394 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:59.362392 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Checking segment: {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:41:59.362822 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Network hostable DHCP agents. Network: 9c8cc949-bd51-40a0-bff3-5527e7341361, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:41:59.387500 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Network 9c8cc949-bd51-40a0-bff3-5527e7341361 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:41:59.399796 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, 9c8cc949-bd51-40a0-bff3-5527e7341361) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:41:59.408916 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:41:59.409663 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.410419 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57932) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:59.415810 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1378573362', 'description': 'tempest-description--1188561167'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:41:59.423850 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:59.424071 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d5a2f3f-9586-41bb-95fc-8aedd71adc71 None None] Network 9c8cc949-bd51-40a0-bff3-5527e7341361 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:41:59.430038 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Usage tracker for resource:security_group and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:59.433828 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:59.436402 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-91b9b458-3415-4259-b8c3-d084df0775d3 admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 0.8399019
May 25 16:41:59.438759 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57936) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:59.440337 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:59.447953 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:41:59.454074 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.454517 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:59.459078 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Usage tracker for resource:router and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:59.462041 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:59.469817 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:59.486387 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:59.492480 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Usage tracker for resource:security_group_rule and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:59.495512 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:59.498538 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-506971', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2375'] for router, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.499647 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-504667', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-501124', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1593705', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2380'] for router, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.501911 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:59.520697 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.595999 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.602506 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.607337 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:59.656553 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event updated for resources: {'SecurityGroup': ['ID=680c886d-79ec-4bd5-9d15-51f1b36f6780,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:59.667681 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:59.668318 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d60576c-5158-50e8-99d6-6272b1af5e3f-9c8cc949-bd51-40a0-bff3-5527e7341361', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784'}]}} from dv-cinder-786386-6-iscsi. {{(pid=92014) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 16:41:59.669101 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.669215 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.673014 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 0.2589760
May 25 16:41:59.673332 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57940) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:59.679297 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-8a99ccfc-6521-4e64-8ae5-e4e945279b34 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Request body: {'security_group_rule': {'security_group_id': '680c886d-79ec-4bd5-9d15-51f1b36f6780', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:41:59.685698 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-8a99ccfc-6521-4e64-8ae5-e4e945279b34 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:59.689445 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-8a99ccfc-6521-4e64-8ae5-e4e945279b34 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Usage tracker for resource:security_group_rule and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:59.693183 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-8a99ccfc-6521-4e64-8ae5-e4e945279b34 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:59.699320 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-8a99ccfc-6521-4e64-8ae5-e4e945279b34 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:59.718015 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8a99ccfc-6521-4e64-8ae5-e4e945279b34 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.788777 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8a99ccfc-6521-4e64-8ae5-e4e945279b34 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.793292 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8a99ccfc-6521-4e64-8ae5-e4e945279b34 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.795485 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:59.819847 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a99ccfc-6521-4e64-8ae5-e4e945279b34 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ae697d72-f1c6-4e2f-92b8-8a3105b70701,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:59.822859 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-8a99ccfc-6521-4e64-8ae5-e4e945279b34 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:41:59.830254 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8a99ccfc-6521-4e64-8ae5-e4e945279b34 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.833997 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-8a99ccfc-6521-4e64-8ae5-e4e945279b34 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1572092
May 25 16:41:59.834283 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57944) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:41:59.839684 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-7b1374f9-20b2-4088-954f-345b39c7e418 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Request body: {'security_group_rule': {'security_group_id': '680c886d-79ec-4bd5-9d15-51f1b36f6780', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:41:59.845723 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-7b1374f9-20b2-4088-954f-345b39c7e418 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:41:59.849758 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-7b1374f9-20b2-4088-954f-345b39c7e418 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Usage tracker for resource:security_group_rule and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:41:59.851705 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.db_base_plugin_common [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Allocated IP 172.20.0.2 (9c8cc949-bd51-40a0-bff3-5527e7341361/2f2f7850-0dc5-48dc-8602-816147b64784/562728d6-bdfc-472c-a19b-dd90e3c07c82) {{(pid=92014) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:41:59.860639 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-7b1374f9-20b2-4088-954f-345b39c7e418 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:41:59.867630 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-7b1374f9-20b2-4088-954f-345b39c7e418 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:41:59.887785 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7b1374f9-20b2-4088-954f-345b39c7e418 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.939351 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-501153', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-506985', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2362'] for router, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.957266 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7b1374f9-20b2-4088-954f-345b39c7e418 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.962333 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7b1374f9-20b2-4088-954f-345b39c7e418 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:41:59.964781 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-8644550f-9ea2-4e6b-8886-500de06a0284 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:41:59.988164 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b1374f9-20b2-4088-954f-345b39c7e418 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8b237801-c752-4470-952c-17206696d244,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:41:59.991530 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-7b1374f9-20b2-4088-954f-345b39c7e418 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:00.002141 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-7b1374f9-20b2-4088-954f-345b39c7e418 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.006403 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-7b1374f9-20b2-4088-954f-345b39c7e418 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1681721
May 25 16:42:00.006562 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 57948) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:00.013254 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Request body: {'floatingip': {'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:00.019066 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:00.023226 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Usage tracker for resource:floatingip and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:00.026389 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:00.033594 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:00.050270 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.093089 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Notify callbacks [] for port, precommit_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.103946 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Transition to ACTIVE for port object 562728d6-bdfc-472c-a19b-dd90e3c07c82 will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:00.123238 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Transition to ACTIVE for port object 562728d6-bdfc-472c-a19b-dd90e3c07c82 will not be triggered until provisioned by entity DHCP. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:00.131227 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.134902 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-a08e0089-1502-441f-956b-aa0553a8002b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:00.201564 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Network 9c8cc949-bd51-40a0-bff3-5527e7341361 is already hosted by enough agents. {{(pid=92014) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:42:00.204568 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.base_scheduler [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Resources bound (agent type, host, resource id):  {{(pid=92014) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:00.208054 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Received port after_create {{(pid=92014) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:42:00.209189 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.213875 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Pushing event updated for resources: {'Port': ['ID=562728d6-bdfc-472c-a19b-dd90e3c07c82,revision_number=1']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:00.250876 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:00.295680 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.314487 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Attempting to bind port 562728d6-bdfc-472c-a19b-dd90e3c07c82 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:42:00.314868 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Attempting to bind port 562728d6-bdfc-472c-a19b-dd90e3c07c82 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:42:00.315237 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Attempting to bind port 562728d6-bdfc-472c-a19b-dd90e3c07c82 on network 9c8cc949-bd51-40a0-bff3-5527e7341361 {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:42:00.321511 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 41, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:42:00.321888 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Checking segment: {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:42:00.322861 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.323352 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Bound using segment: {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:42:00.323839 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Bound port: 562728d6-bdfc-472c-a19b-dd90e3c07c82, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:42:00.324223 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.327138 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.386888 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Allocated IP 172.27.3.144 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/4e12d041-6f9a-4342-84ea-f3d2d019dde4) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:42:00.430131 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] For port 562728d6-bdfc-472c-a19b-dd90e3c07c82, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:42:00.433618 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] For port 562728d6-bdfc-472c-a19b-dd90e3c07c82, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=562728d6-bdfc-472c-a19b-dd90e3c07c82,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:42:00.438575 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.442211 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-75439a7c-96d5-4b78-8527-f573335bb91c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:00.520418 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Pushing event updated for resources: {'Port': ['ID=562728d6-bdfc-472c-a19b-dd90e3c07c82,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:00.523613 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:00.571434 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.603227 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.608572 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:00.676790 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:42:00.678833 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:00.679814 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Allocated IP 172.27.3.123 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/28b6c09e-dcb2-41f5-b478-f761acf64ecc) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:42:00.683513 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:42:00.739409 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event updated for resources: {'Port': ['ID=4e12d041-6f9a-4342-84ea-f3d2d019dde4,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:00.746910 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:00.793139 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.861254 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.871261 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.905012 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:00.909054 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-357bd0ee-ead5-4409-84c2-c7fa8977d855 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:00.973238 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:42:00.976185 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:00.979722 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:42:01.014315 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Pushing event updated for resources: {'Port': ['ID=28b6c09e-dcb2-41f5-b478-f761acf64ecc,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:01.022559 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:01.140613 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 562728d6-bdfc-472c-a19b-dd90e3c07c82 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:01.169934 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:01.176685 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:01.180873 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-437ea345-51fb-4afa-a850-7bc3935078a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:01.247890 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 562728d6-bdfc-472c-a19b-dd90e3c07c82 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:01.301273 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event updated for resources: {'Port': ['ID=4e12d041-6f9a-4342-84ea-f3d2d019dde4,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:01.313110 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:01.322618 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:01.348302 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:01.358136 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.3424323
May 25 16:42:01.423320 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-ffaa9aec-c094-4ce4-bc50-bee002d12da5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:01.495961 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:01.530347 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a93e98ce-c92b-45fc-ba5d-d805327fd2d1 None None] Network 9c8cc949-bd51-40a0-bff3-5527e7341361 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:42:01.638985 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-e95fd5ed-b43c-4c4e-a244-2f28507fa6c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Synchronizing usage tracker for tenant:63f896ab0d7e44158204551033c33ba4 on resource:security_group {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:42:01.651426 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-bcd58574-04d1-4158-98e3-16310c6d3670 None None] Provisioning for port 562728d6-bdfc-472c-a19b-dd90e3c07c82 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:01.657735 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-e95fd5ed-b43c-4c4e-a244-2f28507fa6c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Unset dirty status for tenant:63f896ab0d7e44158204551033c33ba4 on resource:security_group {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:42:01.659266 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-e95fd5ed-b43c-4c4e-a244-2f28507fa6c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?name=tempest-securitygroup--1378573362&fields=id&tenant_id=63f896ab0d7e44158204551033c33ba4 HTTP/1.1" status: 200  len: 267 time: 0.0647473
May 25 16:42:01.670539 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-bcd58574-04d1-4158-98e3-16310c6d3670 None None] Provisioning complete for port 562728d6-bdfc-472c-a19b-dd90e3c07c82 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:01.670999 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-bcd58574-04d1-4158-98e3-16310c6d3670 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:01.823364 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-34a21339-ed3f-4e9f-a3af-d5635945b297 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:01.824902 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-34a21339-ed3f-4e9f-a3af-d5635945b297 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/networks?id=ce683266-622a-4b13-a610-301441bf2882 HTTP/1.1" status: 200  len: 811 time: 0.1573944
May 25 16:42:01.840882 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-8fc2bf52-fee4-408d-8b6b-d7320303bdcb tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/quotas/63f896ab0d7e44158204551033c33ba4 HTTP/1.1" status: 200  len: 375 time: 0.0100882
May 25 16:42:01.923821 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-bcd58574-04d1-4158-98e3-16310c6d3670 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:01.935799 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-49217d16-4681-4290-a759-a10af4f1011f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=63f896ab0d7e44158204551033c33ba4&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0855849
May 25 16:42:01.968415 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-bcd58574-04d1-4158-98e3-16310c6d3670 None None] For port 562728d6-bdfc-472c-a19b-dd90e3c07c82, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=562728d6-bdfc-472c-a19b-dd90e3c07c82,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:01.970147 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-506962', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-501218'] for router, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:01.974564 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-bcd58574-04d1-4158-98e3-16310c6d3670 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:01.976532 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-cae96590-8d26-420b-b5d5-f565cfa1b87b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:02.065133 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcd58574-04d1-4158-98e3-16310c6d3670 None None] Pushing event updated for resources: {'Port': ['ID=562728d6-bdfc-472c-a19b-dd90e3c07c82,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:02.069886 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-bcd58574-04d1-4158-98e3-16310c6d3670 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:02.106875 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-a1d7244f-7339-4571-836b-9fe4e9eb8e9d service neutron] 10.222.0.73 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1593845
May 25 16:42:02.196308 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Router 3ec8f109-cb75-4f41-81bd-ca78638538c9 is scheduled to L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 with binding_index 1 {{(pid=92012) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 16:42:02.198541 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-e8aeddba-b4e0-4639-9e85-0be89070c3e7 None None] Provisioning complete for port 562728d6-bdfc-472c-a19b-dd90e3c07c82 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:02.198963 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-e8aeddba-b4e0-4639-9e85-0be89070c3e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:02.260356 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-83716ba8-e1a8-4fcc-aed3-ed3c92f285bc service neutron] 10.222.0.73 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1442468
May 25 16:42:02.389129 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:42:02.404357 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Sync routers for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:42:02.423431 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:02.424098 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b5d7160>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:41:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:02.428048 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Notify callbacks [] for router, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:02.430006 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] 10.222.0.73 "POST /v2.0/routers HTTP/1.1" status: 201  len: 924 time: 2.9886081
May 25 16:42:02.443449 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 57978) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:02.535093 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d7afb294-1453-4709-ae68-b7b2d3568ce2 req-8b6bcc9d-ad0b-4511-97f5-6fc7da559a08 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 210 time: 0.1015842
May 25 16:42:02.634833 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:02.979899 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b5d7160>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:01Z', 'revision_number': 3, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:02.985208 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Checking router: 3ec8f109-cb75-4f41-81bd-ca78638538c9 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:42:02.985208 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Updating router 3ec8f109-cb75-4f41-81bd-ca78638538c9 port 28b6c09e-dcb2-41f5-b478-f761acf64ecc binding host dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:42:03.081450 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:03.221835 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 562728d6-bdfc-472c-a19b-dd90e3c07c82 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:03.407155 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 562728d6-bdfc-472c-a19b-dd90e3c07c82 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:03.407531 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:03.420991 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:03.625859 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Notify callbacks [] for port, precommit_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:03.643303 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Transition to ACTIVE for port object 28b6c09e-dcb2-41f5-b478-f761acf64ecc will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:03.652397 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:03.659689 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:03.680070 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Allocated IP 172.20.0.1 (9c8cc949-bd51-40a0-bff3-5527e7341361/2f2f7850-0dc5-48dc-8602-816147b64784/98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:42:03.755042 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4b94a65b-d56b-4982-82f8-043afed78dc9 req-46342a32-cf84-430f-abf5-a3225b67ee56 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 210 time: 0.0845833
May 25 16:42:03.794885 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Attempting to bind port 28b6c09e-dcb2-41f5-b478-f761acf64ecc on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:42:03.795850 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Attempting to bind port 28b6c09e-dcb2-41f5-b478-f761acf64ecc by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:42:03.796212 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Attempting to bind port 28b6c09e-dcb2-41f5-b478-f761acf64ecc on network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:42:03.806751 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7d475c-68b5-498f-bdb2-2234f121b73d None None] Pushing event updated for resources: {'Port': ['ID=28b6c09e-dcb2-41f5-b478-f761acf64ecc,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:03.810681 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 41, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:42:03.811949 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Checking segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:42:03.814599 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:03.815091 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Bound using segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:42:03.815645 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Bound port: 28b6c09e-dcb2-41f5-b478-f761acf64ecc, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:42:03.816206 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:03.853443 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-cd7d475c-68b5-498f-bdb2-2234f121b73d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:03.897122 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:03.904830 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:03.913994 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] For port 28b6c09e-dcb2-41f5-b478-f761acf64ecc, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:42:03.914201 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-55bb84b6-6c62-40aa-82f1-c7eb78283141 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:03.915867 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-55bb84b6-6c62-40aa-82f1-c7eb78283141 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.76 "GET /v2.0/networks?id=ce683266-622a-4b13-a610-301441bf2882 HTTP/1.1" status: 200  len: 811 time: 0.2182872
May 25 16:42:03.918097 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] For port 28b6c09e-dcb2-41f5-b478-f761acf64ecc, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=28b6c09e-dcb2-41f5-b478-f761acf64ecc,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:42:03.926735 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:03.928318 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Transition to ACTIVE for port object 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 will not be triggered until provisioned by entity DHCP. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:03.937011 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:03.958339 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:03.963466 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:03.971809 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-4c793a3b-24bb-41ad-9734-275118cded3c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=63f896ab0d7e44158204551033c33ba4 HTTP/1.1" status: 200  len: 380 time: 0.0463009
May 25 16:42:03.986725 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Request body: {'port': {'device_id': '9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'admin_state_up': True, 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'security_groups': ['680c886d-79ec-4bd5-9d15-51f1b36f6780']}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:04.019771 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:04.020588 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b5d7160>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:41:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:04.037715 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Network 9c8cc949-bd51-40a0-bff3-5527e7341361 is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:42:04.040654 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:04.044381 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:42:04.095239 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Pushing event updated for resources: {'Port': ['ID=98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:04.100519 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:04.105667 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-501395'] for router_interface, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:04.150124 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7d475c-68b5-498f-bdb2-2234f121b73d None None] Pushing event updated for resources: {'Port': ['ID=28b6c09e-dcb2-41f5-b478-f761acf64ecc,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:04.156110 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:04.156363 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-f43d9284-e8e5-469f-992a-832769643f66 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:04.157765 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-cd7d475c-68b5-498f-bdb2-2234f121b73d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:04.164109 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Usage tracker for resource:port and tenant:63f896ab0d7e44158204551033c33ba4 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:04.169233 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Quota usage for port was recalculated. Used quota:3. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:04.176050 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:04.187981 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Made reservation on behalf of 63f896ab0d7e44158204551033c33ba4 for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:42:04.192350 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:04.321621 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:04.406051 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Allocated IP 172.20.0.12 (ce683266-622a-4b13-a610-301441bf2882/06161ba6-62a3-443f-9cfb-bccf3f60ad9c/7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:42:04.453647 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:04.555398 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-afbc1d8b-b342-418b-a681-c891679623b4 None None] Provisioning for port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:04.565562 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-afbc1d8b-b342-418b-a681-c891679623b4 None None] Provisioning complete for port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:04.566876 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-afbc1d8b-b342-418b-a681-c891679623b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:04.658788 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:04.663972 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-afbc1d8b-b342-418b-a681-c891679623b4 None None] Port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:42:04.685578 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Transition to ACTIVE for port object 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 will not be triggered until provisioned by entity DHCP. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:04.715897 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:04.723008 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:04.732334 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:04.736000 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b5d7160>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:01Z', 'revision_number': 3, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:04.737790 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:04.740229 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-097ef258-9b4e-492b-9d65-407886e8b35e None None] The sync data for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi is: [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:01Z', 'revision_number': 3, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:42:04.779439 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-01ee778f-4d1a-4b1b-a2a1-1f24b08e72a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:04.798306 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Network ce683266-622a-4b13-a610-301441bf2882 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:42:04.802208 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:04.806363 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:42:04.838091 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event updated for resources: {'Port': ['ID=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:04.844966 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:04.870708 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630485', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-501310'] for router_interface, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:04.876640 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Pushing event updated for resources: {'Port': ['ID=98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:04.881711 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:04.882361 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:04.882484 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:05.042983 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Network 9c8cc949-bd51-40a0-bff3-5527e7341361 is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:42:05.045182 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:05.073042 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:05.096526 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.1148837
May 25 16:42:05.117866 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Request body: {'port': {'device_id': '9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:05.241296 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-38faac8c-f9f7-49d1-b2e6-5c7d48b02ae1 None None] Provisioning for port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:05.254357 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20cea3d5-762f-48f6-8d59-5ad07754e824 req-e5914b6b-911a-4a15-9c44-1dcd2daf047f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:05.254357 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-20cea3d5-762f-48f6-8d59-5ad07754e824 req-e5914b6b-911a-4a15-9c44-1dcd2daf047f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Synchronizing usage tracker for tenant:63f896ab0d7e44158204551033c33ba4 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:42:05.263564 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-38faac8c-f9f7-49d1-b2e6-5c7d48b02ae1 None None] Provisioning complete for port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:05.263941 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-38faac8c-f9f7-49d1-b2e6-5c7d48b02ae1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:05.366341 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-20cea3d5-762f-48f6-8d59-5ad07754e824 req-e5914b6b-911a-4a15-9c44-1dcd2daf047f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Unset dirty status for tenant:63f896ab0d7e44158204551033c33ba4 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:42:05.367383 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Router 3ec8f109-cb75-4f41-81bd-ca78638538c9 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:42:05.367511 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-20cea3d5-762f-48f6-8d59-5ad07754e824 req-e5914b6b-911a-4a15-9c44-1dcd2daf047f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 932 time: 0.4673154
May 25 16:42:05.368345 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-38faac8c-f9f7-49d1-b2e6-5c7d48b02ae1 None None] Port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:42:05.417171 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:05.493690 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-d1f2d37e-2263-4942-84a5-5ff111451c1c None None] Provisioning complete for port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:05.494085 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d1f2d37e-2263-4942-84a5-5ff111451c1c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:05.534084 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-20cea3d5-762f-48f6-8d59-5ad07754e824 req-b974b76f-f6c8-49cb-baf5-73fa2b2c97ea tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=680c886d-79ec-4bd5-9d15-51f1b36f6780&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1486244
May 25 16:42:05.582077 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-d1f2d37e-2263-4942-84a5-5ff111451c1c None None] Port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:42:05.701254 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:42:05.713997 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] 10.222.0.73 "PUT /v2.0/routers/3ec8f109-cb75-4f41-81bd-ca78638538c9/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.2686718
May 25 16:42:05.874138 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:42:05.882234 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:05.897978 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Transition to ACTIVE for port object 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:05.904239 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:05.910604 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c0e01e44-b978-49dd-9101-04fea07066d7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:06.088784 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Pushing event updated for resources: {'Port': ['ID=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:06.121423 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:06.167157 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Attempting to bind port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:42:06.167504 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Attempting to bind port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:42:06.167833 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Attempting to bind port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 on network ce683266-622a-4b13-a610-301441bf2882 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:42:06.173001 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 on network ce683266-622a-4b13-a610-301441bf2882 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:42:06.173322 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Attempting to bind port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 on network ce683266-622a-4b13-a610-301441bf2882 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:42:06.179880 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 41, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:42:06.180223 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Checking segment: {'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:42:06.180859 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Bound using segment: {'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:42:06.181294 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Bound port: 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd81e37c9-589a-4925-890a-a746a946e185', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 430, 'network_id': 'ce683266-622a-4b13-a610-301441bf2882'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:42:06.181858 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:06.284216 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] For port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:42:06.288245 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] For port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:42:06.293573 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:06.304942 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-26b42adb-8cdb-4cdd-9836-161f9c9b276d tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:06.354396 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:06.355287 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:06.360029 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58034) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:06.360467 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] 10.222.0.76 "PUT /v2.0/ports/7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 HTTP/1.1" status: 200  len: 1094 time: 1.2540898
May 25 16:42:06.360991 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5', 'tag': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:42:06.369216 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1857999268-network', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:06.397648 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:06.405576 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Usage tracker for resource:network and tenant:d0bf591a76874ca3957c9de33c471227 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:06.411269 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:06.419012 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:06.436383 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Made reservation on behalf of d0bf591a76874ca3957c9de33c471227 for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:42:06.438967 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:06.448543 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5', 'tag': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473', 'status': 'completed', 'code': 200}
May 25 16:42:06.454667 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:06.458735 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Pushing event updated for resources: {'Port': ['ID=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:06.462454 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:06.480249 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:06.485782 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Usage tracker for resource:security_group_rule and tenant:d0bf591a76874ca3957c9de33c471227 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:06.489927 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:06.497323 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-25820aac-1ef5-41c4-9f85-4e9f44a49dc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:06.498966 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-25820aac-1ef5-41c4-9f85-4e9f44a49dc2 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=63f896ab0d7e44158204551033c33ba4&device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 1097 time: 0.0948610
May 25 16:42:06.500056 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:06.574901 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:06.592068 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-56cad428-4b4c-4ca5-a253-42739a7cff0e service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 HTTP/1.1" status: 200  len: 217 time: 0.0852289
May 25 16:42:06.615513 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:06.621009 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:06.626949 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-099d91e8-d779-456f-aff9-badf88a0da44 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:06.658486 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 412}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:42:06.671924 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04256e36-b9b6-4230-b204-0ce061daa0d4,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:06.676447 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:06.677711 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:06.678213 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Added segment a832ca7e-761b-49eb-9687-0318291c7eb2 of type vlan for network efa74063-00d3-424c-8e6c-15db79789235
May 25 16:42:06.678487 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-b46fffdf-3128-4793-9949-7f2323463e2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:06.680430 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-b46fffdf-3128-4793-9949-7f2323463e2a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=06161ba6-62a3-443f-9cfb-bccf3f60ad9c HTTP/1.1" status: 200  len: 850 time: 0.0816908
May 25 16:42:06.709678 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:06.743533 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:06.745149 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:06.745754 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:06.749574 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-cdb51a4d-a9e2-451a-9cfd-2113e9f94b2a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:06.762024 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Sync routers for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:42:06.775448 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:06.776620 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346c4f68e0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:42:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:06.831060 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-4626142f-3fef-4194-a158-8ff481bf9f76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:06.833126 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-4626142f-3fef-4194-a158-8ff481bf9f76 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ce683266-622a-4b13-a610-301441bf2882&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1447594
May 25 16:42:06.841728 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90014247-da47-4078-96a1-fb484ca3f6dc req-8607c60b-9aa9-40c3-bcad-5905c8ee9250 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:06.843197 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-90014247-da47-4078-96a1-fb484ca3f6dc req-8607c60b-9aa9-40c3-bcad-5905c8ee9250 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 944 time: 0.1137567
May 25 16:42:06.865687 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.5044060
May 25 16:42:06.866721 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Pushing event updated for resources: {'Network': ['ID=efa74063-00d3-424c-8e6c-15db79789235,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:06.868817 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58042) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:06.872951 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:06.878101 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network efa74063-00d3-424c-8e6c-15db79789235 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:42:06.880589 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Request body: {'subnet': {'network_id': 'efa74063-00d3-424c-8e6c-15db79789235', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1857999268-subnet', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'ip_version': 4}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:06.887152 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:06.891455 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Usage tracker for resource:subnet and tenant:d0bf591a76874ca3957c9de33c471227 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:06.895184 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:06.902664 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:06.918973 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Made reservation on behalf of d0bf591a76874ca3957c9de33c471227 for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:42:06.923461 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-697612'] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:07.007434 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-90014247-da47-4078-96a1-fb484ca3f6dc req-f2d299c9-1447-41cf-84a4-936bca090fee tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=680c886d-79ec-4bd5-9d15-51f1b36f6780&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1426208
May 25 16:42:07.012151 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:07.030218 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-23af4ba9-126d-4de5-bd37-8d7eeba1f709 service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1860793
May 25 16:42:07.149936 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 28b6c09e-dcb2-41f5-b478-f761acf64ecc up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:07.285493 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 28b6c09e-dcb2-41f5-b478-f761acf64ecc completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:07.293524 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 28b6c09e-dcb2-41f5-b478-f761acf64ecc triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:07.294172 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:07.329103 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-98d7f198-6e9a-42d4-aa2c-d0ee7e28427e req-7aa99a7a-8160-437f-b129-6230ded5f73c service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2917044
May 25 16:42:07.493294 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:07.508429 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:42:07.525660 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346c4f68e0>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 2, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:07.529885 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 28b6c09e-dcb2-41f5-b478-f761acf64ecc, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=28b6c09e-dcb2-41f5-b478-f761acf64ecc,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:07.531083 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Checking router: 3ec8f109-cb75-4f41-81bd-ca78638538c9 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:42:07.531743 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Updating router 3ec8f109-cb75-4f41-81bd-ca78638538c9 port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 binding host dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:42:07.538823 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:07.542428 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:07.544998 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f122b58-2789-44b7-833b-87bc4ffc1c41 req-e1c2170f-f387-42d3-ba1d-1a1fc3a0134a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:07.549016 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9f122b58-2789-44b7-833b-87bc4ffc1c41 req-e1c2170f-f387-42d3-ba1d-1a1fc3a0134a service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=63f896ab0d7e44158204551033c33ba4&device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 1097 time: 0.1645539
May 25 16:42:07.561893 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7721570', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-697626'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:07.569875 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ec367cb7-17c8-4b87-9e1c-1f5289602905 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:07.631615 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:07.703571 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Pushing event updated for resources: {'Subnet': ['ID=45256ccb-705d-488f-8825-5503d528ba51,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:07.706020 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Checking segment: {'id': 'a832ca7e-761b-49eb-9687-0318291c7eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:42:07.706404 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Network hostable DHCP agents. Network: efa74063-00d3-424c-8e6c-15db79789235, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:42:07.710785 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:07.727335 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=28b6c09e-dcb2-41f5-b478-f761acf64ecc,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:07.734271 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:07.734530 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Network efa74063-00d3-424c-8e6c-15db79789235 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:42:07.750095 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, efa74063-00d3-424c-8e6c-15db79789235) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:07.759331 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fee72cb9-49ca-4cf8-9b57-11edba64a108 None None] Network efa74063-00d3-424c-8e6c-15db79789235 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:42:07.762612 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:07.763474 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:07.766732 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f122b58-2789-44b7-833b-87bc4ffc1c41 req-341a77fd-f8e8-4932-acab-c904825ce4e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:07.768495 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9f122b58-2789-44b7-833b-87bc4ffc1c41 req-341a77fd-f8e8-4932-acab-c904825ce4e9 service neutron] 10.222.0.76 "GET /v2.0/networks?id=ce683266-622a-4b13-a610-301441bf2882 HTTP/1.1" status: 200  len: 912 time: 0.2121830
May 25 16:42:07.790175 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-56a3f303-3df4-4c7a-9ebb-354a5c21119a admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 0.9175177
May 25 16:42:07.791177 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58062) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:07.796922 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1857999268-router', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:07.804047 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:07.808491 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Usage tracker for resource:router and tenant:d0bf591a76874ca3957c9de33c471227 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:07.811729 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:07.817982 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:07.831244 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-506971', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2375'] for router, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:07.833050 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-504667', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-501124', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1593705', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2380'] for router, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:07.851317 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:07.913850 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9f122b58-2789-44b7-833b-87bc4ffc1c41 req-732609ce-00d5-4178-b2e2-bc88aed8b551 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 HTTP/1.1" status: 200  len: 217 time: 0.1366167
May 25 16:42:07.985225 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58066) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:08.004892 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f122b58-2789-44b7-833b-87bc4ffc1c41 req-06b5b3f9-c8ee-41ee-b4a5-614c810d19dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:08.006519 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9f122b58-2789-44b7-833b-87bc4ffc1c41 req-06b5b3f9-c8ee-41ee-b4a5-614c810d19dd service neutron] 10.222.0.76 "GET /v2.0/subnets?id=06161ba6-62a3-443f-9cfb-bccf3f60ad9c HTTP/1.1" status: 200  len: 850 time: 0.0860868
May 25 16:42:08.140787 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Notify callbacks [] for port, precommit_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.153544 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f122b58-2789-44b7-833b-87bc4ffc1c41 req-b1dd5511-5587-444e-a445-a5bcc674cdcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:08.154322 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d60576c-5158-50e8-99d6-6272b1af5e3f-efa74063-00d3-424c-8e6c-15db79789235', 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'fixed_ips': [{'subnet_id': '45256ccb-705d-488f-8825-5503d528ba51'}]}} from dv-cinder-786386-6-iscsi. {{(pid=92014) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 16:42:08.156257 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.158355 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9f122b58-2789-44b7-833b-87bc4ffc1c41 req-b1dd5511-5587-444e-a445-a5bcc674cdcd service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ce683266-622a-4b13-a610-301441bf2882&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1381013
May 25 16:42:08.161589 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.provisioning_blocks [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Transition to ACTIVE for port object 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 will not be triggered until provisioned by entity L2. {{(pid=92015) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:08.180134 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.200286 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:08.230184 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-501153', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-506985', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2362'] for router, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.340395 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b705ab17-ab9a-43d7-a241-49aa1d521d3b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.388525 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.db_base_plugin_common [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Allocated IP 172.20.0.2 (efa74063-00d3-424c-8e6c-15db79789235/45256ccb-705d-488f-8825-5503d528ba51/7fff4511-d58a-4a65-958a-c586cd556f89) {{(pid=92014) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:42:08.389978 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-b705ab17-ab9a-43d7-a241-49aa1d521d3b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:08.425032 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Pushing event updated for resources: {'Port': ['ID=98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1,revision_number=3']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:08.427221 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-b705ab17-ab9a-43d7-a241-49aa1d521d3b admin admin] Usage tracker for resource:security_group_rule and tenant:9f0d6e438cba4266adbcbd604ec5fc87 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:08.435181 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-b705ab17-ab9a-43d7-a241-49aa1d521d3b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:08.449448 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-b705ab17-ab9a-43d7-a241-49aa1d521d3b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:08.459654 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:08.459996 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:08.460308 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:08.460628 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:08.460941 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:08.461254 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:08.461587 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:08.461894 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:08.462223 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:08.462598 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:08.462833 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:08.463661 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:08.480552 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.280s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:08.483113 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Attempting to bind port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:42:08.483502 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Attempting to bind port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:42:08.483859 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Attempting to bind port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 on network 9c8cc949-bd51-40a0-bff3-5527e7341361 {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:42:08.488814 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9f122b58-2789-44b7-833b-87bc4ffc1c41 req-56407b3d-d4cb-4cb3-ae79-c3fcebcb2389 service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3236010
May 25 16:42:08.495587 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 42, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:42:08.496014 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Checking segment: {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92015) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:42:08.496391 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.496782 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Bound using segment: {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:42:08.497261 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Bound port: 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'}}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:42:08.497696 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.563305 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ef98f8-443a-4183-9f8e-5da679224fd9 req-a5360b1a-cb26-40d2-b087-cc17f815703f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:08.564800 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f6ef98f8-443a-4183-9f8e-5da679224fd9 req-a5360b1a-cb26-40d2-b087-cc17f815703f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 944 time: 0.3545120
May 25 16:42:08.628480 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] For port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92015) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:42:08.634151 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] For port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92015) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:42:08.642157 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.648674 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-dd064559-2bc0-4ed0-a7f3-7360e97a2bb3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:08.689472 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Notify callbacks [] for port, precommit_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.705524 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Transition to ACTIVE for port object 7fff4511-d58a-4a65-958a-c586cd556f89 will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:08.732735 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Transition to ACTIVE for port object 7fff4511-d58a-4a65-958a-c586cd556f89 will not be triggered until provisioned by entity DHCP. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:08.737617 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f6ef98f8-443a-4183-9f8e-5da679224fd9 req-b4c8205e-e8cc-4340-a298-2c6bfc2b78ba tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=680c886d-79ec-4bd5-9d15-51f1b36f6780&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1094592
May 25 16:42:08.757250 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.769824 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:08.777966 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Pushing event updated for resources: {'Port': ['ID=98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1,revision_number=4']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:08.782375 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-d92894b7-0c0e-4a7a-9775-0b4301b6c5e7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:08.810304 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:08.810511 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9f122b58-2789-44b7-833b-87bc4ffc1c41 req-1e88612d-a951-4466-86b3-3e1df8bcac3a service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3028798
May 25 16:42:08.811436 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346c4f68e0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:42:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:08.825442 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.827284 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Network efa74063-00d3-424c-8e6c-15db79789235 is already hosted by enough agents. {{(pid=92014) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:42:08.836070 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b705ab17-ab9a-43d7-a241-49aa1d521d3b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.841629 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.base_scheduler [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Resources bound (agent type, host, resource id):  {{(pid=92014) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:08.846415 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Received port after_create {{(pid=92014) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:42:08.848688 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b705ab17-ab9a-43d7-a241-49aa1d521d3b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.860774 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6f1295fc-5583-4389-ad2a-c0138b3fbea7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:08.873109 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.913438 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b705ab17-ab9a-43d7-a241-49aa1d521d3b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bc9dbdf7-e0c1-42d7-8edc-ec2f1d69f00d,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:08.917063 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-b705ab17-ab9a-43d7-a241-49aa1d521d3b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:08.920410 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-b705ab17-ab9a-43d7-a241-49aa1d521d3b admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=9f0d6e438cba4266adbcbd604ec5fc87&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9349794
May 25 16:42:08.923022 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58076) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:08.969611 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Pushing event updated for resources: {'Port': ['ID=7fff4511-d58a-4a65-958a-c586cd556f89,revision_number=1']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:08.975340 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:08.981182 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Attempting to bind port 7fff4511-d58a-4a65-958a-c586cd556f89 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:42:08.982131 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Attempting to bind port 7fff4511-d58a-4a65-958a-c586cd556f89 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': 'a832ca7e-761b-49eb-9687-0318291c7eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:42:08.983122 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Attempting to bind port 7fff4511-d58a-4a65-958a-c586cd556f89 on network efa74063-00d3-424c-8e6c-15db79789235 {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:42:08.990505 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 42, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:42:08.990929 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Checking segment: {'id': 'a832ca7e-761b-49eb-9687-0318291c7eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:42:08.991476 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:08.991974 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Bound using segment: {'id': 'a832ca7e-761b-49eb-9687-0318291c7eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:42:08.992685 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Bound port: 7fff4511-d58a-4a65-958a-c586cd556f89, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a832ca7e-761b-49eb-9687-0318291c7eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:42:08.993884 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:09.000197 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd74af00-a8c7-4388-94ec-dc9c4aad8713 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:09.036530 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd74af00-a8c7-4388-94ec-dc9c4aad8713 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:09.107130 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:09.113145 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd74af00-a8c7-4388-94ec-dc9c4aad8713 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:09.118251 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-cb76f212-7158-4f9a-9fb1-b53d7020515f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:09.122647 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] For port 7fff4511-d58a-4a65-958a-c586cd556f89, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:42:09.126248 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] For port 7fff4511-d58a-4a65-958a-c586cd556f89, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=7fff4511-d58a-4a65-958a-c586cd556f89,segment=NetworkSegment(a832ca7e-761b-49eb-9687-0318291c7eb2),segment_id=a832ca7e-761b-49eb-9687-0318291c7eb2)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:42:09.131993 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:09.132455 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd74af00-a8c7-4388-94ec-dc9c4aad8713 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc9dbdf7-e0c1-42d7-8edc-ec2f1d69f00d,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:09.135048 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-bd74af00-a8c7-4388-94ec-dc9c4aad8713 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:09.139385 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd74af00-a8c7-4388-94ec-dc9c4aad8713 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:09.143170 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-bd74af00-a8c7-4388-94ec-dc9c4aad8713 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/bc9dbdf7-e0c1-42d7-8edc-ec2f1d69f00d HTTP/1.1" status: 204  len: 168 time: 0.2157910
May 25 16:42:09.148405 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:09.183052 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Allocated IP 172.27.3.249 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/9fc0f568-b8c7-404d-a3ea-aefdfddce437) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:42:09.201802 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 28b6c09e-dcb2-41f5-b478-f761acf64ecc up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:09.290656 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:42:09.341978 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Pushing event updated for resources: {'Port': ['ID=7fff4511-d58a-4a65-958a-c586cd556f89,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:09.353275 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:09.396009 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:09.452187 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:09.464552 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:09.478594 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 28b6c09e-dcb2-41f5-b478-f761acf64ecc triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:09.479243 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:09.518877 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:42:09.524966 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:09.535037 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:42:09.581229 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346c4f68e0>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:08Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:09.585538 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d82c666-b7a7-4ae8-8972-583d427e9096 None None] The sync data for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi is: [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:08Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:42:09.775358 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:09.810706 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'port_id': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473', 'mac_address': 'fa:16:3e:d8:da:b8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 430, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:42:09.926507 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:09.962309 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Pushing event updated for resources: {'Port': ['ID=9fc0f568-b8c7-404d-a3ea-aefdfddce437,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:09.966979 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.502s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:09.973577 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:42:09.997306 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:10.006039 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:10.008794 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:10.085179 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3625fb79-2ea6-4ef9-8406-0bf9c8963e96 req-13796e21-5c76-47ef-839a-830834cfce5f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:10.087311 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3625fb79-2ea6-4ef9-8406-0bf9c8963e96 req-13796e21-5c76-47ef-839a-830834cfce5f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 944 time: 0.1707537
May 25 16:42:10.111642 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:10.115234 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:10.150049 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3625fb79-2ea6-4ef9-8406-0bf9c8963e96 req-8f11f3ea-171b-4f86-80f8-4f055fe6b4a6 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=680c886d-79ec-4bd5-9d15-51f1b36f6780&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0554349
May 25 16:42:10.238880 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:42:10.240834 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:10.641050 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84e514d8-b184-47f8-8fca-c76fb6744402 None None] Network efa74063-00d3-424c-8e6c-15db79789235 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:42:10.690121 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-506962', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-501218'] for router, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:10.768061 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-e41489e0-f385-45a9-b931-4405b4644226 None None] Provisioning for port 7fff4511-d58a-4a65-958a-c586cd556f89 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:11.090601 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Router 4328317b-18e9-4036-b7d9-0b3a94388219 is scheduled to L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 with binding_index 1 {{(pid=92012) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 16:42:11.241751 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:11.304235 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:11.401191 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:42:11.427306 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Sync routers for ids ['4328317b-18e9-4036-b7d9-0b3a94388219'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:42:11.449646 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Notify callbacks [] for router, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:11.453945 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] 10.222.0.73 "POST /v2.0/routers HTTP/1.1" status: 201  len: 924 time: 3.6615582
May 25 16:42:11.455008 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58148) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:11.463805 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Routers {'4328317b-18e9-4036-b7d9-0b3a94388219'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:11.464474 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346ba656d0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:42:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['4328317b-18e9-4036-b7d9-0b3a94388219'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:11.485828 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d68aa71-508a-417d-90bf-baa9d4274d0b req-8e1508c0-adc2-4b84-a1bb-32512b6b9f33 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:11.487784 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0d68aa71-508a-417d-90bf-baa9d4274d0b req-8e1508c0-adc2-4b84-a1bb-32512b6b9f33 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 945 time: 0.1309452
May 25 16:42:11.539873 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0d68aa71-508a-417d-90bf-baa9d4274d0b req-c1ab8329-648c-47f9-ac60-be84813bb4b6 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=680c886d-79ec-4bd5-9d15-51f1b36f6780&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0460992
May 25 16:42:11.596869 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:11.655893 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:11.677063 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:11.677665 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:11.701961 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:11.702333 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:11.819730 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Set router 4328317b-18e9-4036-b7d9-0b3a94388219 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:12.139289 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:12.158782 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:12.199418 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:12.245199 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:12.254487 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:42:12.266768 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:12.268468 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:12.269836 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 7fff4511-d58a-4a65-958a-c586cd556f89 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:12.300728 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:12.336251 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473', 'code': 200}
May 25 16:42:12.345374 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:12.416540 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:12.423281 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:12.426441 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.059s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:12.472782 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Allocated IP 172.20.0.1 (efa74063-00d3-424c-8e6c-15db79789235/45256ccb-705d-488f-8825-5503d528ba51/57e8d6da-a2a8-4df1-bfc4-609a7549fc5f) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:42:12.529315 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346ba656d0>, [{'id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'name': 'tempest-TestVolumeBootPattern-1857999268-router', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249'}], 'enable_snat': True}, 'gw_port_id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:42:07Z', 'updated_at': '2021-05-25T16:42:09Z', 'revision_number': 3, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'gw_port': {'id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:dc:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'device_owner': 'network:router_gateway', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:08Z', 'updated_at': '2021-05-25T16:42:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:12.531947 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 7fff4511-d58a-4a65-958a-c586cd556f89 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:12.547126 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 7fff4511-d58a-4a65-958a-c586cd556f89 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:12.547641 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:12.586587 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Checking router: 4328317b-18e9-4036-b7d9-0b3a94388219 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:42:12.587042 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Updating router 4328317b-18e9-4036-b7d9-0b3a94388219 port 9fc0f568-b8c7-404d-a3ea-aefdfddce437 binding host dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:42:12.658882 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:12.694659 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:12.709131 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.283s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:12.712210 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e6e1205-1531-4594-9d9d-ab102e50d743 req-ebdbc277-bc3b-4e4e-a46f-f3fb6fd31f22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:12.713704 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7e6e1205-1531-4594-9d9d-ab102e50d743 req-ebdbc277-bc3b-4e4e-a46f-f3fb6fd31f22 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 1099 time: 0.1487515
May 25 16:42:12.792644 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:12.820842 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.provisioning_blocks [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Transition to ACTIVE for port object 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f will not be triggered until provisioned by entity DHCP. {{(pid=92012) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:12.851774 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7e6e1205-1531-4594-9d9d-ab102e50d743 req-e76786e9-d8a0-4819-b216-734577068d5b service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=680c886d-79ec-4bd5-9d15-51f1b36f6780&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1308086
May 25 16:42:12.858008 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:12.863088 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b18cc049-7b57-4a14-9fab-21b4a59d37e1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:12.867488 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d045da09-ba7f-4028-a224-22f6d087d462 req-9de3186d-30f4-46dd-ab61-82578b9b465b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:12.873946 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d045da09-ba7f-4028-a224-22f6d087d462 req-9de3186d-30f4-46dd-ab61-82578b9b465b tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 946 time: 0.1235802
May 25 16:42:12.924950 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d045da09-ba7f-4028-a224-22f6d087d462 req-6a473820-8894-46bc-a9c6-aa51dc57710f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=680c886d-79ec-4bd5-9d15-51f1b36f6780&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0498128
May 25 16:42:13.014462 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.048616 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Network efa74063-00d3-424c-8e6c-15db79789235 is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:42:13.052107 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:13.056248 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:42:13.081734 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 7fff4511-d58a-4a65-958a-c586cd556f89, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=7fff4511-d58a-4a65-958a-c586cd556f89,segment=NetworkSegment(a832ca7e-761b-49eb-9687-0318291c7eb2),segment_id=a832ca7e-761b-49eb-9687-0318291c7eb2)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:13.093499 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.094456 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Pushing event updated for resources: {'Port': ['ID=57e8d6da-a2a8-4df1-bfc4-609a7549fc5f,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:13.096862 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:13.105738 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:13.124633 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-501395'] for router_interface, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.223546 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=7fff4511-d58a-4a65-958a-c586cd556f89,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:13.239663 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:13.271281 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:13.291358 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.318751 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Notify callbacks [] for port, precommit_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.333157 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-2b7a112e-b8a5-4171-881a-b7a88e1ff02b None None] Provisioning for port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:13.340924 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Transition to ACTIVE for port object 9fc0f568-b8c7-404d-a3ea-aefdfddce437 will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:13.343200 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-2b7a112e-b8a5-4171-881a-b7a88e1ff02b None None] Provisioning complete for port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:13.343564 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2b7a112e-b8a5-4171-881a-b7a88e1ff02b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.383779 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.395723 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:13.479350 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-2b7a112e-b8a5-4171-881a-b7a88e1ff02b None None] Port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:42:13.486280 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Attempting to bind port 9fc0f568-b8c7-404d-a3ea-aefdfddce437 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:42:13.486646 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Attempting to bind port 9fc0f568-b8c7-404d-a3ea-aefdfddce437 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:42:13.487004 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Attempting to bind port 9fc0f568-b8c7-404d-a3ea-aefdfddce437 on network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:42:13.493241 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:13.493636 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.518738 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a93754-8b47-42d5-bcb5-53e5fc5313fd None None] Pushing event updated for resources: {'Port': ['ID=9fc0f568-b8c7-404d-a3ea-aefdfddce437,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:13.526315 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 42, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:42:13.526715 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Checking segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:42:13.527568 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.527670 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.527670 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Bound using segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:42:13.527950 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Bound port: 9fc0f568-b8c7-404d-a3ea-aefdfddce437, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:42:13.528327 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.531795 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.556392 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-26a93754-8b47-42d5-bcb5-53e5fc5313fd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:13.562245 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-6de8aa5c-da9a-47c6-a0a6-936a6d2ca962 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:13.648099 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630485', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-501310'] for router_interface, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.654762 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Pushing event updated for resources: {'Port': ['ID=57e8d6da-a2a8-4df1-bfc4-609a7549fc5f,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:13.658997 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:13.663077 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] For port 9fc0f568-b8c7-404d-a3ea-aefdfddce437, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:42:13.694610 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] For port 9fc0f568-b8c7-404d-a3ea-aefdfddce437, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=9fc0f568-b8c7-404d-a3ea-aefdfddce437,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:42:13.713652 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:13.719410 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:13.809106 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Routers {'4328317b-18e9-4036-b7d9-0b3a94388219'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:13.809753 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346ba656d0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:42:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['4328317b-18e9-4036-b7d9-0b3a94388219'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:13.822635 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Network efa74063-00d3-424c-8e6c-15db79789235 is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:42:13.824039 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:13.881889 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a93754-8b47-42d5-bcb5-53e5fc5313fd None None] Pushing event updated for resources: {'Port': ['ID=9fc0f568-b8c7-404d-a3ea-aefdfddce437,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:13.895500 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-26a93754-8b47-42d5-bcb5-53e5fc5313fd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:14.039026 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] Set router 4328317b-18e9-4036-b7d9-0b3a94388219 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:14.041871 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Router 4328317b-18e9-4036-b7d9-0b3a94388219 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:42:14.186229 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30a2f60c-83bf-4b0a-9fdb-b297e43dff42 req-34682dbe-eba2-4a45-9fa9-0dc752c7cc41 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:14.188559 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-30a2f60c-83bf-4b0a-9fdb-b297e43dff42 req-34682dbe-eba2-4a45-9fa9-0dc752c7cc41 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 946 time: 0.1200969
May 25 16:42:14.202178 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:14.210475 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-d6ff29de-62f5-448e-a06c-4c7ad86eaa29 None None] Provisioning complete for port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:14.210849 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d6ff29de-62f5-448e-a06c-4c7ad86eaa29 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:14.256422 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:42:14.262368 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-30a2f60c-83bf-4b0a-9fdb-b297e43dff42 req-0d1e7930-31ad-4f96-8632-8ad825443f13 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=680c886d-79ec-4bd5-9d15-51f1b36f6780&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0554521
May 25 16:42:14.269475 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] 10.222.0.73 "PUT /v2.0/routers/4328317b-18e9-4036-b7d9-0b3a94388219/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8108575
May 25 16:42:14.384308 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-d6ff29de-62f5-448e-a06c-4c7ad86eaa29 None None] Port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:42:14.502797 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bd98e6e-bab4-4fee-bbe9-d85949c6c75a req-27ebf0dc-6507-48b4-a07e-bd658b581ec5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:14.504514 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3bd98e6e-bab4-4fee-bbe9-d85949c6c75a req-27ebf0dc-6507-48b4-a07e-bd658b581ec5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 946 time: 0.0907018
May 25 16:42:14.513253 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58192) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:14.519564 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-f7e63b30-e73b-481b-a08f-27780e503d9c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Request body: {'floatingip': {'port_id': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:14.525360 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346ba656d0>, [{'id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'name': 'tempest-TestVolumeBootPattern-1857999268-router', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249'}], 'enable_snat': True}, 'gw_port_id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:42:07Z', 'updated_at': '2021-05-25T16:42:13Z', 'revision_number': 4, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'gw_port': {'id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:dc:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'device_owner': 'network:router_gateway', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:08Z', 'updated_at': '2021-05-25T16:42:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '57e8d6da-a2a8-4df1-bfc4-609a7549fc5f', 'name': '', 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'mac_address': 'fa:16:3e:c5:42:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'device_owner': 'network:router_interface', 'standard_attr_id': 520, 'fixed_ips': [{'subnet_id': '45256ccb-705d-488f-8825-5503d528ba51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:12Z', 'updated_at': '2021-05-25T16:42:13Z', 'revision_number': 2, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'subnets': [{'id': '45256ccb-705d-488f-8825-5503d528ba51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:14.530502 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76614dee-9006-43ef-bfda-1e3916ba5639 None None] The sync data for ids ['4328317b-18e9-4036-b7d9-0b3a94388219'] in dv-cinder-786386-6-iscsi is: [{'id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'name': 'tempest-TestVolumeBootPattern-1857999268-router', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249'}], 'enable_snat': True}, 'gw_port_id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:42:07Z', 'updated_at': '2021-05-25T16:42:13Z', 'revision_number': 4, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'gw_port': {'id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:dc:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'device_owner': 'network:router_gateway', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:08Z', 'updated_at': '2021-05-25T16:42:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '57e8d6da-a2a8-4df1-bfc4-609a7549fc5f', 'name': '', 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'mac_address': 'fa:16:3e:c5:42:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'device_owner': 'network:router_interface', 'standard_attr_id': 520, 'fixed_ips': [{'subnet_id': '45256ccb-705d-488f-8825-5503d528ba51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:12Z', 'updated_at': '2021-05-25T16:42:13Z', 'revision_number': 2, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'subnets': [{'id': '45256ccb-705d-488f-8825-5503d528ba51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:42:14.651241 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f7e63b30-e73b-481b-a08f-27780e503d9c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:15.220819 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 7fff4511-d58a-4a65-958a-c586cd556f89 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:15.255992 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58204) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:15.262599 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1587326533', 'description': 'tempest-secgroup-smoke-1587326533 description', 'project_id': '577d706beb414387a68972cf7e8d0285'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:15.270273 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:15.275902 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Usage tracker for resource:security_group and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:15.278906 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:15.290495 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:15.305267 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 7fff4511-d58a-4a65-958a-c586cd556f89 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:15.305932 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:15.313202 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:15.338204 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:15.343761 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Usage tracker for resource:security_group_rule and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:15.347474 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:15.356259 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:15.438194 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:15.445131 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:15.458150 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:15.505248 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'SecurityGroup': ['ID=63866e13-b231-485d-a031-21b53f908d39,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:15.511374 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:15.518700 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:15.520086 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.2630420
May 25 16:42:15.523320 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58208) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:15.529752 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-0e05cc1a-a4d1-4d28-83e6-148cbdcee26a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Request body: {'security_group_rule': {'security_group_id': '63866e13-b231-485d-a031-21b53f908d39', 'project_id': '577d706beb414387a68972cf7e8d0285', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:15.610423 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-0e05cc1a-a4d1-4d28-83e6-148cbdcee26a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:15.631258 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-0e05cc1a-a4d1-4d28-83e6-148cbdcee26a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Usage tracker for resource:security_group_rule and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:15.636131 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-0e05cc1a-a4d1-4d28-83e6-148cbdcee26a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:15.645026 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-0e05cc1a-a4d1-4d28-83e6-148cbdcee26a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:15.665751 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f7e63b30-e73b-481b-a08f-27780e503d9c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:15.672350 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f7e63b30-e73b-481b-a08f-27780e503d9c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:15.748336 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0e05cc1a-a4d1-4d28-83e6-148cbdcee26a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:15.913788 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0e05cc1a-a4d1-4d28-83e6-148cbdcee26a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:15.919226 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.l3_db [None req-f7e63b30-e73b-481b-a08f-27780e503d9c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Floating IP b2dc0c55-8abb-41f2-815a-17cf5300c6f0 associated. External IP: 172.27.3.144, port: 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473.
May 25 16:42:15.967102 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0e05cc1a-a4d1-4d28-83e6-148cbdcee26a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:15.975206 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:16.026715 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e05cc1a-a4d1-4d28-83e6-148cbdcee26a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=01f10fc0-012f-4a80-94de-8f8f9a2e6dff,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:16.031880 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0e05cc1a-a4d1-4d28-83e6-148cbdcee26a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:16.040644 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0e05cc1a-a4d1-4d28-83e6-148cbdcee26a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:16.042100 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-0e05cc1a-a4d1-4d28-83e6-148cbdcee26a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.5174048
May 25 16:42:16.045110 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58216) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:16.067270 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-384ea19f-c1ea-490e-aaa1-ec7984d5f7b3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Request body: {'security_group_rule': {'security_group_id': '63866e13-b231-485d-a031-21b53f908d39', 'project_id': '577d706beb414387a68972cf7e8d0285', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:16.101816 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-384ea19f-c1ea-490e-aaa1-ec7984d5f7b3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:16.118810 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-384ea19f-c1ea-490e-aaa1-ec7984d5f7b3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Usage tracker for resource:security_group_rule and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:16.123394 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-384ea19f-c1ea-490e-aaa1-ec7984d5f7b3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:16.130456 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-384ea19f-c1ea-490e-aaa1-ec7984d5f7b3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:16.310851 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-384ea19f-c1ea-490e-aaa1-ec7984d5f7b3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:16.407282 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-384ea19f-c1ea-490e-aaa1-ec7984d5f7b3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:16.412971 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-384ea19f-c1ea-490e-aaa1-ec7984d5f7b3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:16.422397 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-32592bec-cc3b-4fc5-a2a9-a68ddb147ffb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:16.450682 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-384ea19f-c1ea-490e-aaa1-ec7984d5f7b3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=58bf8a89-37c1-436c-a355-6a947d8c494d,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:16.454867 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-384ea19f-c1ea-490e-aaa1-ec7984d5f7b3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:16.474882 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7e63b30-e73b-481b-a08f-27780e503d9c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Router d0ffdac8-c8d7-4bac-8f41-858898f1783d has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:42:16.525028 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-384ea19f-c1ea-490e-aaa1-ec7984d5f7b3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:16.527167 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-384ea19f-c1ea-490e-aaa1-ec7984d5f7b3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.4801159
May 25 16:42:16.536991 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58224) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:16.543511 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-88f020c7-3c10-4314-9b83-b220735bede8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Request body: {'security_group_rule': {'security_group_id': '63866e13-b231-485d-a031-21b53f908d39', 'project_id': '577d706beb414387a68972cf7e8d0285', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:16.572118 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-88f020c7-3c10-4314-9b83-b220735bede8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:16.583308 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-88f020c7-3c10-4314-9b83-b220735bede8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Usage tracker for resource:security_group_rule and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:16.590770 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-88f020c7-3c10-4314-9b83-b220735bede8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:16.607598 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-88f020c7-3c10-4314-9b83-b220735bede8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:16.645970 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1d1616-51ea-4735-929e-61174d5d0003 req-a4ebdb7f-5697-4074-b1f9-8fce8bfb4639 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:16.647551 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-aa1d1616-51ea-4735-929e-61174d5d0003 req-a4ebdb7f-5697-4074-b1f9-8fce8bfb4639 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 946 time: 0.1908853
May 25 16:42:16.649239 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-88f020c7-3c10-4314-9b83-b220735bede8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:16.726452 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7e63b30-e73b-481b-a08f-27780e503d9c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:42:16.735468 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f7e63b30-e73b-481b-a08f-27780e503d9c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:16.743851 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0c08779-1988-424c-8a59-db5dcd54c21f None None] Sync routers for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:42:16.762184 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-aa1d1616-51ea-4735-929e-61174d5d0003 req-28beb0b3-5200-4378-bda6-b71f195812ca tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1036751
May 25 16:42:16.772629 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0c08779-1988-424c-8a59-db5dcd54c21f None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:16.773281 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-f0c08779-1988-424c-8a59-db5dcd54c21f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b71e5b0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:42:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:16.798853 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-88f020c7-3c10-4314-9b83-b220735bede8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:16.810283 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-88f020c7-3c10-4314-9b83-b220735bede8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:16.821053 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:16.832407 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f7e63b30-e73b-481b-a08f-27780e503d9c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "PUT /v2.0/floatingips/b2dc0c55-8abb-41f2-815a-17cf5300c6f0 HTTP/1.1" status: 200  len: 992 time: 2.3153892
May 25 16:42:16.832407 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5', 'tag': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:42:16.863881 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88f020c7-3c10-4314-9b83-b220735bede8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7a63d072-692b-4f27-8e09-05cd911db123,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:16.866778 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-88f020c7-3c10-4314-9b83-b220735bede8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:16.869902 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-88f020c7-3c10-4314-9b83-b220735bede8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.3301117
May 25 16:42:16.871151 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-88f020c7-3c10-4314-9b83-b220735bede8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:16.871739 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58232) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:16.877626 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-6e1b7fb1-12eb-4c61-872f-d65055fedeb3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Request body: {'security_group_rule': {'security_group_id': '63866e13-b231-485d-a031-21b53f908d39', 'project_id': '577d706beb414387a68972cf7e8d0285', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:16.885573 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-6e1b7fb1-12eb-4c61-872f-d65055fedeb3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:16.889958 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-6e1b7fb1-12eb-4c61-872f-d65055fedeb3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Usage tracker for resource:security_group_rule and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:16.893313 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-6e1b7fb1-12eb-4c61-872f-d65055fedeb3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:16.905956 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-6e1b7fb1-12eb-4c61-872f-d65055fedeb3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:16.922313 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5', 'tag': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473', 'status': 'completed', 'code': 200}
May 25 16:42:16.930939 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6e1b7fb1-12eb-4c61-872f-d65055fedeb3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.027340 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-f0c08779-1988-424c-8a59-db5dcd54c21f None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:17.059823 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6e1b7fb1-12eb-4c61-872f-d65055fedeb3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.072418 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6e1b7fb1-12eb-4c61-872f-d65055fedeb3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.110400 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:17.132075 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a567da70-2d0d-4f3d-98e4-23fe75dcb399 req-f5132272-721d-4ac2-827e-3a533236f08b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:17.133567 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a567da70-2d0d-4f3d-98e4-23fe75dcb399 req-f5132272-721d-4ac2-827e-3a533236f08b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=63f896ab0d7e44158204551033c33ba4&device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 1099 time: 0.1847422
May 25 16:42:17.137336 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1b7fb1-12eb-4c61-872f-d65055fedeb3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3b1b0fe0-b93e-440d-951c-7e6b28db6ebf,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:17.140108 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6e1b7fb1-12eb-4c61-872f-d65055fedeb3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:17.170007 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6e1b7fb1-12eb-4c61-872f-d65055fedeb3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.171275 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-6e1b7fb1-12eb-4c61-872f-d65055fedeb3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.2984185
May 25 16:42:17.176097 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58238) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:17.182659 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-5a868e53-8c31-4ba1-ae7a-3e80ec693ca3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Request body: {'security_group_rule': {'security_group_id': '63866e13-b231-485d-a031-21b53f908d39', 'project_id': '577d706beb414387a68972cf7e8d0285', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:17.197909 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-5a868e53-8c31-4ba1-ae7a-3e80ec693ca3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:17.204521 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-5a868e53-8c31-4ba1-ae7a-3e80ec693ca3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Usage tracker for resource:security_group_rule and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:17.208236 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-5a868e53-8c31-4ba1-ae7a-3e80ec693ca3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:17.215120 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-5a868e53-8c31-4ba1-ae7a-3e80ec693ca3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:17.242703 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.securitygroups_db [None req-5a868e53-8c31-4ba1-ae7a-3e80ec693ca3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Project 577d706beb414387a68972cf7e8d0285 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 25 16:42:17.251489 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5a868e53-8c31-4ba1-ae7a-3e80ec693ca3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.268370 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 9fc0f568-b8c7-404d-a3ea-aefdfddce437 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:17.331811 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a567da70-2d0d-4f3d-98e4-23fe75dcb399 req-d8038812-2781-48a3-99f9-2874328043fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:17.332884 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a567da70-2d0d-4f3d-98e4-23fe75dcb399 req-d8038812-2781-48a3-99f9-2874328043fa service neutron] 10.222.0.76 "GET /v2.0/networks?id=ce683266-622a-4b13-a610-301441bf2882 HTTP/1.1" status: 200  len: 912 time: 0.1911621
May 25 16:42:17.348773 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5a868e53-8c31-4ba1-ae7a-3e80ec693ca3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.352867 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 9fc0f568-b8c7-404d-a3ea-aefdfddce437 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:17.364272 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 9fc0f568-b8c7-404d-a3ea-aefdfddce437 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:17.364650 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.366482 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5a868e53-8c31-4ba1-ae7a-3e80ec693ca3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.402077 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-56f03719-b3ea-4c16-b583-5b1175097c05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:17.421205 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a868e53-8c31-4ba1-ae7a-3e80ec693ca3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=35c9c380-5db0-48e9-be15-0d9714a03234,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:17.429770 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-5a868e53-8c31-4ba1-ae7a-3e80ec693ca3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:17.431396 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5a868e53-8c31-4ba1-ae7a-3e80ec693ca3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.435717 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-5a868e53-8c31-4ba1-ae7a-3e80ec693ca3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.2553611
May 25 16:42:17.435717 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58242) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:17.451925 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-14e377db-c7b8-453f-b5a4-307e77cf8ea3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Request body: {'security_group_rule': {'security_group_id': '63866e13-b231-485d-a031-21b53f908d39', 'project_id': '577d706beb414387a68972cf7e8d0285', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:17.459307 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-14e377db-c7b8-453f-b5a4-307e77cf8ea3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:17.463580 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-14e377db-c7b8-453f-b5a4-307e77cf8ea3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Usage tracker for resource:security_group_rule and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:17.467043 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-14e377db-c7b8-453f-b5a4-307e77cf8ea3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:17.467256 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a567da70-2d0d-4f3d-98e4-23fe75dcb399 req-d6ceb746-14ea-40e3-8946-4fcdbabe0bae service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 HTTP/1.1" status: 200  len: 1000 time: 0.1202555
May 25 16:42:17.473712 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-14e377db-c7b8-453f-b5a4-307e77cf8ea3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:17.488576 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.securitygroups_db [None req-14e377db-c7b8-453f-b5a4-307e77cf8ea3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Project 577d706beb414387a68972cf7e8d0285 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 25 16:42:17.498663 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-14e377db-c7b8-453f-b5a4-307e77cf8ea3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.550926 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a567da70-2d0d-4f3d-98e4-23fe75dcb399 req-c45effca-b968-4968-81f7-42f7b3274cdd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:17.552579 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a567da70-2d0d-4f3d-98e4-23fe75dcb399 req-c45effca-b968-4968-81f7-42f7b3274cdd service neutron] 10.222.0.76 "GET /v2.0/subnets?id=06161ba6-62a3-443f-9cfb-bccf3f60ad9c HTTP/1.1" status: 200  len: 850 time: 0.0780852
May 25 16:42:17.559052 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-f0c08779-1988-424c-8a59-db5dcd54c21f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b71e5b0>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': 'b2dc0c55-8abb-41f2-815a-17cf5300c6f0', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'floating_ip_address': '172.27.3.144', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'port_id': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 501, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'mac_address': 'fa:16:3e:d8:da:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:15Z', 'revision_number': 1, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:41Z', 'revision_number': 5, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:17.564223 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0c08779-1988-424c-8a59-db5dcd54c21f None None] Checking router: d0ffdac8-c8d7-4bac-8f41-858898f1783d for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:42:17.590919 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.594001 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-14e377db-c7b8-453f-b5a4-307e77cf8ea3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.594820 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0c08779-1988-424c-8a59-db5dcd54c21f None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:17.595796 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-f0c08779-1988-424c-8a59-db5dcd54c21f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b71e5b0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:42:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:17.602143 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-14e377db-c7b8-453f-b5a4-307e77cf8ea3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.614378 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-82e55a7c-99de-4c70-aa06-b62e915eef1c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:17.625913 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 9fc0f568-b8c7-404d-a3ea-aefdfddce437, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=9fc0f568-b8c7-404d-a3ea-aefdfddce437,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:17.637624 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.643006 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-cae96590-8d26-420b-b5d5-f565cfa1b87b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:17.664471 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14e377db-c7b8-453f-b5a4-307e77cf8ea3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=be60b04b-7334-427b-82c9-4c4b294cad13,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:17.670868 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-14e377db-c7b8-453f-b5a4-307e77cf8ea3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:17.675503 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a567da70-2d0d-4f3d-98e4-23fe75dcb399 req-55438531-8f3a-4ff7-8944-a00949157431 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:17.677264 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a567da70-2d0d-4f3d-98e4-23fe75dcb399 req-55438531-8f3a-4ff7-8944-a00949157431 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=ce683266-622a-4b13-a610-301441bf2882&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1179087
May 25 16:42:17.697275 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-14e377db-c7b8-453f-b5a4-307e77cf8ea3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:17.698858 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-14e377db-c7b8-453f-b5a4-307e77cf8ea3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.2621858
May 25 16:42:17.742487 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=9fc0f568-b8c7-404d-a3ea-aefdfddce437,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:17.747919 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:17.892676 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a567da70-2d0d-4f3d-98e4-23fe75dcb399 req-2d7c582f-371b-4b40-8109-9e9e0574957a service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2071948
May 25 16:42:17.901820 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-f0c08779-1988-424c-8a59-db5dcd54c21f None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:18.114788 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a567da70-2d0d-4f3d-98e4-23fe75dcb399 req-73dcaec1-7879-4936-a02f-e2d272eae54d service neutron] 10.222.0.76 "GET /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2150288
May 25 16:42:18.128600 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-c46fe871-6648-4bd1-9f71-544dd63978c9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:18.131849 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-c46fe871-6648-4bd1-9f71-544dd63978c9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.76 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 946 time: 0.1452470
May 25 16:42:18.174556 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Sync routers for ids ['4328317b-18e9-4036-b7d9-0b3a94388219'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:42:18.188456 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Routers {'4328317b-18e9-4036-b7d9-0b3a94388219'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:18.191248 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346aa96e50>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:42:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['4328317b-18e9-4036-b7d9-0b3a94388219'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:18.418992 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bda59ae1-1b3a-4d1f-902c-5109a165b594 req-0babca0f-4154-4adb-8560-effc4e108313 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:18.427131 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bda59ae1-1b3a-4d1f-902c-5109a165b594 req-0babca0f-4154-4adb-8560-effc4e108313 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 946 time: 0.4454858
May 25 16:42:18.458000 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Deleting port 07e04c0f-8286-42fc-96c2-0e366da529c6 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:42:18.458536 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:18.497519 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-f0c08779-1988-424c-8a59-db5dcd54c21f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b71e5b0>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': 'b2dc0c55-8abb-41f2-815a-17cf5300c6f0', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'floating_ip_address': '172.27.3.144', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'port_id': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 501, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'mac_address': 'fa:16:3e:d8:da:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:15Z', 'revision_number': 1, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:41Z', 'revision_number': 5, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:18.502531 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0c08779-1988-424c-8a59-db5dcd54c21f None None] The sync data for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi is: [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': 'b2dc0c55-8abb-41f2-815a-17cf5300c6f0', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'floating_ip_address': '172.27.3.144', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'port_id': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 501, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'mac_address': 'fa:16:3e:d8:da:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:15Z', 'revision_number': 1, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:41Z', 'revision_number': 5, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:42:18.504292 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Set router 4328317b-18e9-4036-b7d9-0b3a94388219 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:18.611835 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bda59ae1-1b3a-4d1f-902c-5109a165b594 req-4701b1ca-9fe1-43b0-a342-11c6635d3e4d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=e55c7544-e1f5-49f7-94eb-8071743f84da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1838267
May 25 16:42:18.674715 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] For port 07e04c0f-8286-42fc-96c2-0e366da529c6, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=07e04c0f-8286-42fc-96c2-0e366da529c6,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:18.675774 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:18.875915 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2f5e13d-dd0f-462a-a19d-07a494068668 None None] New status for floating IP b2dc0c55-8abb-41f2-815a-17cf5300c6f0: ACTIVE {{(pid=92015) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:42:18.921043 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346aa96e50>, [{'id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'name': 'tempest-TestVolumeBootPattern-1857999268-router', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249'}], 'enable_snat': True}, 'gw_port_id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:42:07Z', 'updated_at': '2021-05-25T16:42:13Z', 'revision_number': 4, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'gw_port': {'id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:dc:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'device_owner': 'network:router_gateway', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:08Z', 'updated_at': '2021-05-25T16:42:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '57e8d6da-a2a8-4df1-bfc4-609a7549fc5f', 'name': '', 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'mac_address': 'fa:16:3e:c5:42:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'device_owner': 'network:router_interface', 'standard_attr_id': 520, 'fixed_ips': [{'subnet_id': '45256ccb-705d-488f-8825-5503d528ba51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:12Z', 'updated_at': '2021-05-25T16:42:13Z', 'revision_number': 2, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'subnets': [{'id': '45256ccb-705d-488f-8825-5503d528ba51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:18.925961 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Checking router: 4328317b-18e9-4036-b7d9-0b3a94388219 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:42:18.926450 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Updating router 4328317b-18e9-4036-b7d9-0b3a94388219 port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f binding host dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:42:19.003816 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:19.113149 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:19.113428 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:19.113858 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.l3_db [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Floating IP 080265cc-e8b2-46ad-ad82-80676ac12375 disassociated. External IP: 172.27.3.100, port: 07e04c0f-8286-42fc-96c2-0e366da529c6.
May 25 16:42:19.114239 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Calling delete_port for 07e04c0f-8286-42fc-96c2-0e366da529c6 owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:42:19.286237 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 9fc0f568-b8c7-404d-a3ea-aefdfddce437 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:19.286473 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:19.294276 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:19.352405 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event deleted for resources: {'Port': ['ID=07e04c0f-8286-42fc-96c2-0e366da529c6,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:19.355598 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:19.414839 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 9fc0f568-b8c7-404d-a3ea-aefdfddce437 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:19.415213 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:19.563355 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:42:19.583277 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Notify callbacks [] for port, precommit_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:19.614443 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Transition to ACTIVE for port object 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:19.625065 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:19.629502 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-26a93754-8b47-42d5-bcb5-53e5fc5313fd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:19.774155 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:42:19.812856 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450046c1-0fe9-4ac0-9035-a096be8ab679 None None] Pushing event updated for resources: {'Port': ['ID=57e8d6da-a2a8-4df1-bfc4-609a7549fc5f,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:19.815981 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68187d7-99c4-4f34-ba89-c1e17c069161 None None] Sync routers for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:42:19.832777 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-450046c1-0fe9-4ac0-9035-a096be8ab679 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:19.842646 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e68187d7-99c4-4f34-ba89-c1e17c069161 None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:19.843557 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-e68187d7-99c4-4f34-ba89-c1e17c069161 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346abdfd00>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:42:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:19.942248 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] No DVR routers for this DVR port 07e04c0f-8286-42fc-96c2-0e366da529c6 on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:42:19.945380 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-38ab9de9-1972-4744-ab6a-e6157e4f62fe req-ce5a9e76-8ffb-4666-994e-db0151eb5e9f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=f193b888-613a-4d01-a738-0c43d97877b4 HTTP/1.1" status: 200  len: 210 time: 0.0850880
May 25 16:42:19.948022 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:19.950873 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'name': 'network-vif-deleted', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:42:19.961366 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0bb485dd-02f4-43df-aeb4-04191a8bee3f req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.76 "DELETE /v2.0/ports/07e04c0f-8286-42fc-96c2-0e366da529c6 HTTP/1.1" status: 204  len: 173 time: 1.8145909
May 25 16:42:20.016819 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f193b888-613a-4d01-a738-0c43d97877b4', 'name': 'network-vif-deleted', 'tag': '07e04c0f-8286-42fc-96c2-0e366da529c6', 'status': 'completed', 'code': 200}
May 25 16:42:20.159317 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Attempting to bind port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:42:20.159679 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Attempting to bind port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': 'a832ca7e-761b-49eb-9687-0318291c7eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:42:20.160038 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Attempting to bind port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f on network efa74063-00d3-424c-8e6c-15db79789235 {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:42:20.184766 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 42, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:42:20.185143 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Checking segment: {'id': 'a832ca7e-761b-49eb-9687-0318291c7eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:42:20.185566 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:20.185943 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Bound using segment: {'id': 'a832ca7e-761b-49eb-9687-0318291c7eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:42:20.186413 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Bound port: 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a832ca7e-761b-49eb-9687-0318291c7eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:42:20.186776 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:20.262683 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-e68187d7-99c4-4f34-ba89-c1e17c069161 None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:20.451896 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] For port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:42:20.561120 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] For port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=57e8d6da-a2a8-4df1-bfc4-609a7549fc5f,segment=NetworkSegment(a832ca7e-761b-49eb-9687-0318291c7eb2),segment_id=a832ca7e-761b-49eb-9687-0318291c7eb2)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:42:20.570521 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:20.578309 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-f851a7cd-9212-4309-950b-d68c8d6308ca None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:20.695783 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Routers {'4328317b-18e9-4036-b7d9-0b3a94388219'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:20.696426 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346aa96e50>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:42:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['4328317b-18e9-4036-b7d9-0b3a94388219'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:20.784891 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450046c1-0fe9-4ac0-9035-a096be8ab679 None None] Pushing event updated for resources: {'Port': ['ID=57e8d6da-a2a8-4df1-bfc4-609a7549fc5f,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:20.797483 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-450046c1-0fe9-4ac0-9035-a096be8ab679 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:20.961716 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] Set router 4328317b-18e9-4036-b7d9-0b3a94388219 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:21.026055 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-e68187d7-99c4-4f34-ba89-c1e17c069161 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346abdfd00>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:59Z', 'revision_number': 5, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:21.035964 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68187d7-99c4-4f34-ba89-c1e17c069161 None None] Checking router: c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:42:21.093675 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58330) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:21.139775 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e68187d7-99c4-4f34-ba89-c1e17c069161 None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:21.140417 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-e68187d7-99c4-4f34-ba89-c1e17c069161 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346abdfd00>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:42:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:21.175951 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3fa002ea-5035-4876-9ac0-de050bb461ce tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:21.209692 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3fa002ea-5035-4876-9ac0-de050bb461ce tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:21.265068 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:21.279053 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3fa002ea-5035-4876-9ac0-de050bb461ce tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:21.283249 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-56776b02-d539-4c63-9a40-31b214605a43 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:21.300320 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fa002ea-5035-4876-9ac0-de050bb461ce tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e55c7544-e1f5-49f7-94eb-8071743f84da,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:21.302566 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-3fa002ea-5035-4876-9ac0-de050bb461ce tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:21.311596 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 07e04c0f-8286-42fc-96c2-0e366da529c6 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:42:21.313832 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-3fa002ea-5035-4876-9ac0-de050bb461ce tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:21.318092 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-3fa002ea-5035-4876-9ac0-de050bb461ce tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "DELETE /v2.0/security-groups/e55c7544-e1f5-49f7-94eb-8071743f84da HTTP/1.1" status: 204  len: 168 time: 0.2209661
May 25 16:42:21.318590 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58334) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:21.335203 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.api.v2.resource [None req-5b4de3be-6240-47a3-a9b7-0c615d024c82 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] show failed (client error): The resource could not be found.
May 25 16:42:21.339278 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-5b4de3be-6240-47a3-a9b7-0c615d024c82 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups/e55c7544-e1f5-49f7-94eb-8071743f84da HTTP/1.1" status: 404  len: 347 time: 0.0166736
May 25 16:42:21.339466 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58338) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:21.386778 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 07e04c0f-8286-42fc-96c2-0e366da529c6 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:42:21.387173 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 07e04c0f-8286-42fc-96c2-0e366da529c6 not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:42:21.572968 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-f7dffedb-2867-49f2-8c3f-1d6ff0b8427e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Deleting port f01dd4a7-f96a-43b1-ae66-ddeeffbc7586 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:42:21.573306 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-f7dffedb-2867-49f2-8c3f-1d6ff0b8427e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:21.621599 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:21.634166 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-e68187d7-99c4-4f34-ba89-c1e17c069161 None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:21.696822 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:21.697465 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:21.709846 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-f7dffedb-2867-49f2-8c3f-1d6ff0b8427e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:21.710336 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-f7dffedb-2867-49f2-8c3f-1d6ff0b8427e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:21.945369 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-f7dffedb-2867-49f2-8c3f-1d6ff0b8427e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Calling delete_port for f01dd4a7-f96a-43b1-ae66-ddeeffbc7586 owned by network:floatingip {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:42:22.018535 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346aa96e50>, [{'id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'name': 'tempest-TestVolumeBootPattern-1857999268-router', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249'}], 'enable_snat': True}, 'gw_port_id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:42:07Z', 'updated_at': '2021-05-25T16:42:13Z', 'revision_number': 4, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'gw_port': {'id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:dc:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'device_owner': 'network:router_gateway', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:08Z', 'updated_at': '2021-05-25T16:42:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '57e8d6da-a2a8-4df1-bfc4-609a7549fc5f', 'name': '', 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'mac_address': 'fa:16:3e:c5:42:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'device_owner': 'network:router_interface', 'standard_attr_id': 520, 'fixed_ips': [{'subnet_id': '45256ccb-705d-488f-8825-5503d528ba51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:12Z', 'updated_at': '2021-05-25T16:42:20Z', 'revision_number': 4, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'subnets': [{'id': '45256ccb-705d-488f-8825-5503d528ba51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:22.042137 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c55cee01-927f-4910-8cb0-241c4f8db5e6 None None] The sync data for ids ['4328317b-18e9-4036-b7d9-0b3a94388219'] in dv-cinder-786386-6-iscsi is: [{'id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'name': 'tempest-TestVolumeBootPattern-1857999268-router', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249'}], 'enable_snat': True}, 'gw_port_id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:42:07Z', 'updated_at': '2021-05-25T16:42:13Z', 'revision_number': 4, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'gw_port': {'id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:dc:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'device_owner': 'network:router_gateway', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:08Z', 'updated_at': '2021-05-25T16:42:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '57e8d6da-a2a8-4df1-bfc4-609a7549fc5f', 'name': '', 'network_id': 'efa74063-00d3-424c-8e6c-15db79789235', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'mac_address': 'fa:16:3e:c5:42:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'device_owner': 'network:router_interface', 'standard_attr_id': 520, 'fixed_ips': [{'subnet_id': '45256ccb-705d-488f-8825-5503d528ba51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:12Z', 'updated_at': '2021-05-25T16:42:20Z', 'revision_number': 4, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'subnets': [{'id': '45256ccb-705d-488f-8825-5503d528ba51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:42:22.074695 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:22.092271 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-f7dffedb-2867-49f2-8c3f-1d6ff0b8427e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:22.097137 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6e47f5cd-537c-4873-b3b2-b3896d130586 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:22.124762 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=57e8d6da-a2a8-4df1-bfc4-609a7549fc5f,segment=NetworkSegment(a832ca7e-761b-49eb-9687-0318291c7eb2),segment_id=a832ca7e-761b-49eb-9687-0318291c7eb2)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:22.139456 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:22.142182 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:22.149077 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7dffedb-2867-49f2-8c3f-1d6ff0b8427e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event deleted for resources: {'Port': ['ID=f01dd4a7-f96a-43b1-ae66-ddeeffbc7586,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:22.152068 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-f7dffedb-2867-49f2-8c3f-1d6ff0b8427e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:22.217126 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-e68187d7-99c4-4f34-ba89-c1e17c069161 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346abdfd00>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:59Z', 'revision_number': 5, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:22.225065 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68187d7-99c4-4f34-ba89-c1e17c069161 None None] The sync data for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi is: [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:59Z', 'revision_number': 5, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:42:22.226584 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=57e8d6da-a2a8-4df1-bfc4-609a7549fc5f,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:22.229671 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:22.261584 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-f7dffedb-2867-49f2-8c3f-1d6ff0b8427e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:22.272581 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-f7dffedb-2867-49f2-8c3f-1d6ff0b8427e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:22.273746 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-f7dffedb-2867-49f2-8c3f-1d6ff0b8427e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "DELETE /v2.0/floatingips/080265cc-e8b2-46ad-ad82-80676ac12375 HTTP/1.1" status: 204  len: 168 time: 0.9333689
May 25 16:42:22.517805 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58350) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:22.523861 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Request body: {'security_group': {'name': 'tempest-securitygroup--67099906', 'description': 'tempest-description--250456417'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:22.531372 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:22.537951 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Usage tracker for resource:security_group and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:22.541222 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:22.553329 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:22.565882 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:22.584269 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8228c8c-f7ac-4bca-9ed3-678390cd5c48 None None] New status for floating IP 080265cc-e8b2-46ad-ad82-80676ac12375: DOWN {{(pid=92015) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:42:22.590557 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:22.594979 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Usage tracker for resource:security_group_rule and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:22.598629 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:22.605887 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:22.702309 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:22.707524 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:22.713625 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-cac4777d-81b4-44c7-8f28-9d0b46c1002c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:22.766649 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event updated for resources: {'SecurityGroup': ['ID=409cae44-c363-4438-9964-178dc61344f5,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:22.770576 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:22.771681 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:22.772993 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1777 time: 0.2538972
May 25 16:42:22.776135 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58358) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:22.782199 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-c73a77c9-7e80-41cd-85ec-1f1e63d83108 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Request body: {'security_group_rule': {'security_group_id': '409cae44-c363-4438-9964-178dc61344f5', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:22.789507 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c73a77c9-7e80-41cd-85ec-1f1e63d83108 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:22.799092 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c73a77c9-7e80-41cd-85ec-1f1e63d83108 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Usage tracker for resource:security_group_rule and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:22.802201 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c73a77c9-7e80-41cd-85ec-1f1e63d83108 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:22.810301 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c73a77c9-7e80-41cd-85ec-1f1e63d83108 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:22.834739 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c73a77c9-7e80-41cd-85ec-1f1e63d83108 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:22.915051 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c73a77c9-7e80-41cd-85ec-1f1e63d83108 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:22.918994 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c73a77c9-7e80-41cd-85ec-1f1e63d83108 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:22.921040 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0e05cc1a-a4d1-4d28-83e6-148cbdcee26a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:22.943861 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c73a77c9-7e80-41cd-85ec-1f1e63d83108 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e553743d-263d-4467-bfef-f3dde789d35b,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:22.948174 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c73a77c9-7e80-41cd-85ec-1f1e63d83108 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:22.953367 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c73a77c9-7e80-41cd-85ec-1f1e63d83108 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:22.954544 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c73a77c9-7e80-41cd-85ec-1f1e63d83108 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1772687
May 25 16:42:22.957733 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58362) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:22.962754 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-1e3449ce-0ed0-4b0b-994a-ecdd8a74c70a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Request body: {'security_group_rule': {'security_group_id': '409cae44-c363-4438-9964-178dc61344f5', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:22.968433 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-1e3449ce-0ed0-4b0b-994a-ecdd8a74c70a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:22.973873 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-1e3449ce-0ed0-4b0b-994a-ecdd8a74c70a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Usage tracker for resource:security_group_rule and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:22.978081 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-1e3449ce-0ed0-4b0b-994a-ecdd8a74c70a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:22.984850 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-1e3449ce-0ed0-4b0b-994a-ecdd8a74c70a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:23.000308 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1e3449ce-0ed0-4b0b-994a-ecdd8a74c70a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:23.066292 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1e3449ce-0ed0-4b0b-994a-ecdd8a74c70a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:23.070172 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1e3449ce-0ed0-4b0b-994a-ecdd8a74c70a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:23.072566 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-41a040b1-53c8-492d-a639-268c308825b3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:23.197788 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:23.226528 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e3449ce-0ed0-4b0b-994a-ecdd8a74c70a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1660399e-8010-4c6d-801d-b0462a92427d,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:23.229831 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-1e3449ce-0ed0-4b0b-994a-ecdd8a74c70a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:23.238626 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1e3449ce-0ed0-4b0b-994a-ecdd8a74c70a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:23.239853 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-1e3449ce-0ed0-4b0b-994a-ecdd8a74c70a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2812152
May 25 16:42:23.243043 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58368) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:23.248931 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Request body: {'floatingip': {'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:23.255390 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:23.260601 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Usage tracker for resource:floatingip and tenant:9c4a08443867402386f8ec58d2615739 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:23.263513 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:23.269837 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:23.274691 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:23.275068 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:23.281477 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:23.424634 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:23.575104 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Allocated IP 172.27.3.99 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/d45be22e-c7ec-4db1-8047-c7a4e9f93476) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:42:23.727267 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:23.760274 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:23.764266 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:23.832110 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:42:23.835001 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:23.838810 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:42:23.894660 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event updated for resources: {'Port': ['ID=d45be22e-c7ec-4db1-8047-c7a4e9f93476,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:23.898667 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:23.933183 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:23.993082 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:24.206284 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:24.211591 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:24.216132 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-532433b4-04e5-40f8-a1ef-0906e4a6088b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:24.326614 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event updated for resources: {'Port': ['ID=d45be22e-c7ec-4db1-8047-c7a4e9f93476,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:24.330655 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:24.339422 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:24.361911 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:24.363096 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 1.1189830
May 25 16:42:24.895817 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-8017d387-8bf0-414d-a524-acf6971734e8 req-72a5a817-e024-475b-aec8-c847aaaeade3 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Synchronizing usage tracker for tenant:9c4a08443867402386f8ec58d2615739 on resource:security_group {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:42:24.920288 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-8017d387-8bf0-414d-a524-acf6971734e8 req-72a5a817-e024-475b-aec8-c847aaaeade3 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Unset dirty status for tenant:9c4a08443867402386f8ec58d2615739 on resource:security_group {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:42:24.922872 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-72a5a817-e024-475b-aec8-c847aaaeade3 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?name=tempest-securitygroup--67099906&fields=id&tenant_id=9c4a08443867402386f8ec58d2615739 HTTP/1.1" status: 200  len: 267 time: 0.0686367
May 25 16:42:25.084575 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6c69a9a4-bb0c-4520-bb40-2f166ecc9278 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:25.086050 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6c69a9a4-bb0c-4520-bb40-2f166ecc9278 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/networks?id=b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 200  len: 817 time: 0.1559668
May 25 16:42:25.100657 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-f654e083-a436-442c-b527-90b778740c8e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/quotas/9c4a08443867402386f8ec58d2615739 HTTP/1.1" status: 200  len: 375 time: 0.0090885
May 25 16:42:25.188820 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-8017d387-8bf0-414d-a524-acf6971734e8 req-849675a9-718c-4276-b155-a32d06f82756 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Synchronizing usage tracker for tenant:9c4a08443867402386f8ec58d2615739 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:42:25.205739 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-8017d387-8bf0-414d-a524-acf6971734e8 req-849675a9-718c-4276-b155-a32d06f82756 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Unset dirty status for tenant:9c4a08443867402386f8ec58d2615739 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:42:25.207010 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-849675a9-718c-4276-b155-a32d06f82756 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=9c4a08443867402386f8ec58d2615739&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1013970
May 25 16:42:25.395837 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-584804d7-122d-456c-8c78-f268ceb3c309 service neutron] 10.222.0.73 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1770349
May 25 16:42:25.537005 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-b292a0bc-0871-4f06-85e4-49cc4dfb6de4 service neutron] 10.222.0.73 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1345210
May 25 16:42:25.739149 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9f920a38-b7e3-49e1-b279-2ab3593a289f req-989ef7fc-c6ff-4d08-b83e-d9bfe6ba8cf9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 210 time: 0.0484247
May 25 16:42:26.899637 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2dc16e71-d5dc-401e-829c-f5051c70f328 req-2cc45ae3-decf-426d-86d4-35d8f61f89f2 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 210 time: 0.0492997
May 25 16:42:27.115371 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8017d387-8bf0-414d-a524-acf6971734e8 req-0f98e0fc-37b8-44bc-ab2b-eb25fbbd85e4 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:27.116805 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-0f98e0fc-37b8-44bc-ab2b-eb25fbbd85e4 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.76 "GET /v2.0/networks?id=b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 200  len: 817 time: 0.1612833
May 25 16:42:27.187606 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-565bd6a9-9d49-4bc7-823b-a8fc297a9204 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9c4a08443867402386f8ec58d2615739 HTTP/1.1" status: 200  len: 378 time: 0.0529621
May 25 16:42:27.200255 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Request body: {'port': {'device_id': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'admin_state_up': True, 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'security_groups': ['409cae44-c363-4438-9964-178dc61344f5']}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:27.342586 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:27.352746 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:27.363523 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Made reservation on behalf of 9c4a08443867402386f8ec58d2615739 for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:42:27.367218 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:27.533797 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Allocated IP 172.20.0.8 (b8cabc9a-0f6f-485c-8020-441b42ac019b/950695d6-8663-4ed4-92fd-b43d8ea5a820/5c47c017-af78-4c20-a79c-f54715856946) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:42:27.812761 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:27.828461 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Transition to ACTIVE for port object 5c47c017-af78-4c20-a79c-f54715856946 will not be triggered until provisioned by entity DHCP. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:27.853368 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:27.859446 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:27.924759 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Network b8cabc9a-0f6f-485c-8020-441b42ac019b is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:42:27.928948 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:27.933738 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:42:27.977136 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event updated for resources: {'Port': ['ID=5c47c017-af78-4c20-a79c-f54715856946,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:27.988555 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:28.022432 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:28.023060 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:28.100925 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.9058471
May 25 16:42:28.121555 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Request body: {'port': {'device_id': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:28.129765 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-0b4ed226-c4bc-405a-ab61-b2225c402a54 None None] Provisioning for port 5c47c017-af78-4c20-a79c-f54715856946 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:28.134562 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-0b4ed226-c4bc-405a-ab61-b2225c402a54 None None] Provisioning complete for port 5c47c017-af78-4c20-a79c-f54715856946 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:28.134938 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-0b4ed226-c4bc-405a-ab61-b2225c402a54 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:28.177853 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d0fb51-7598-427b-a491-283d6edba893 req-27bef5a2-4e00-4e38-90be-a45799b68c94 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:28.178526 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-60d0fb51-7598-427b-a491-283d6edba893 req-27bef5a2-4e00-4e38-90be-a45799b68c94 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Synchronizing usage tracker for tenant:9c4a08443867402386f8ec58d2615739 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:42:28.190026 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-0b4ed226-c4bc-405a-ab61-b2225c402a54 None None] Port 5c47c017-af78-4c20-a79c-f54715856946 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:42:28.241731 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-60d0fb51-7598-427b-a491-283d6edba893 req-27bef5a2-4e00-4e38-90be-a45799b68c94 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Unset dirty status for tenant:9c4a08443867402386f8ec58d2615739 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:42:28.242854 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-60d0fb51-7598-427b-a491-283d6edba893 req-27bef5a2-4e00-4e38-90be-a45799b68c94 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 931 time: 0.2155952
May 25 16:42:28.301649 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:28.326535 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-60d0fb51-7598-427b-a491-283d6edba893 req-3a37ec9a-85e7-48a9-b22f-25a4ab1d0592 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0768456
May 25 16:42:28.665502 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5c47c017-af78-4c20-a79c-f54715856946 {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:42:28.672733 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:28.687280 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Transition to ACTIVE for port object 5c47c017-af78-4c20-a79c-f54715856946 will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:28.690836 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:28.694244 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6761e8eb-a3ce-4204-8109-8ef3231e4d66 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:28.854256 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Pushing event updated for resources: {'Port': ['ID=5c47c017-af78-4c20-a79c-f54715856946,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:28.861492 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:28.928848 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Attempting to bind port 5c47c017-af78-4c20-a79c-f54715856946 on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:42:28.929524 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Attempting to bind port 5c47c017-af78-4c20-a79c-f54715856946 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:42:28.929524 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Attempting to bind port 5c47c017-af78-4c20-a79c-f54715856946 on network b8cabc9a-0f6f-485c-8020-441b42ac019b {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:42:28.934268 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Port 5c47c017-af78-4c20-a79c-f54715856946 on network b8cabc9a-0f6f-485c-8020-441b42ac019b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:42:28.934581 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Attempting to bind port 5c47c017-af78-4c20-a79c-f54715856946 on network b8cabc9a-0f6f-485c-8020-441b42ac019b {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:42:28.939542 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 42, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:42:28.939873 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Checking segment: {'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:42:28.940266 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Bound using segment: {'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:42:28.940676 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Bound port: 5c47c017-af78-4c20-a79c-f54715856946, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 414, 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:42:28.941014 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:29.036422 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] For port 5c47c017-af78-4c20-a79c-f54715856946, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:42:29.039710 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] For port 5c47c017-af78-4c20-a79c-f54715856946, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=5c47c017-af78-4c20-a79c-f54715856946,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:42:29.044559 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:29.048857 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:29.106081 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:29.106688 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:29.108030 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] 10.222.0.76 "PUT /v2.0/ports/5c47c017-af78-4c20-a79c-f54715856946 HTTP/1.1" status: 200  len: 1093 time: 0.9944875
May 25 16:42:29.108513 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'tag': '5c47c017-af78-4c20-a79c-f54715856946'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:42:29.130882 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Pushing event updated for resources: {'Port': ['ID=5c47c017-af78-4c20-a79c-f54715856946,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:29.134558 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:29.197616 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'tag': '5c47c017-af78-4c20-a79c-f54715856946', 'status': 'completed', 'code': 200}
May 25 16:42:29.240099 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8017d387-8bf0-414d-a524-acf6971734e8 req-65624570-2963-4a8f-8101-d2f8d2e134f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:29.241602 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-65624570-2963-4a8f-8101-d2f8d2e134f0 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9c4a08443867402386f8ec58d2615739&device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 1096 time: 0.0816655
May 25 16:42:29.311490 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-32a49021-a9d3-4540-ae70-b61cd04a9c86 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5c47c017-af78-4c20-a79c-f54715856946 HTTP/1.1" status: 200  len: 217 time: 0.0614517
May 25 16:42:29.383822 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8017d387-8bf0-414d-a524-acf6971734e8 req-b5868707-7491-4e93-870d-b50bfa527c7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:29.385532 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-b5868707-7491-4e93-870d-b50bfa527c7e service neutron] 10.222.0.76 "GET /v2.0/subnets?id=950695d6-8663-4ed4-92fd-b43d8ea5a820 HTTP/1.1" status: 200  len: 856 time: 0.0641847
May 25 16:42:29.538696 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8017d387-8bf0-414d-a524-acf6971734e8 req-13614035-78bf-495f-81e0-9e0161b7306d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:29.540149 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-13614035-78bf-495f-81e0-9e0161b7306d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b8cabc9a-0f6f-485c-8020-441b42ac019b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1469469
May 25 16:42:29.577348 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fcd5736-4a41-450d-9997-04b48912a816 req-4af82e88-0c44-43ed-a24f-2c83ee4cb66f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:29.578799 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5fcd5736-4a41-450d-9997-04b48912a816 req-4af82e88-0c44-43ed-a24f-2c83ee4cb66f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.1283772
May 25 16:42:29.789689 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5fcd5736-4a41-450d-9997-04b48912a816 req-eb34e601-bb26-493a-867c-707da4212935 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.1647089
May 25 16:42:29.830286 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-a29239bc-6ade-4122-863b-655ae108b5fb service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2817905
May 25 16:42:29.973660 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8017d387-8bf0-414d-a524-acf6971734e8 req-4fe68353-d033-4570-b3ba-981b6f44c576 service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1369407
May 25 16:42:30.087233 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf693d19-a3f0-4470-b661-b7ecba821a70 req-f78020e4-77fc-41ac-af08-7479ca69a80c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:30.088790 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cf693d19-a3f0-4470-b661-b7ecba821a70 req-f78020e4-77fc-41ac-af08-7479ca69a80c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9c4a08443867402386f8ec58d2615739&device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 1096 time: 0.0704143
May 25 16:42:30.226514 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf693d19-a3f0-4470-b661-b7ecba821a70 req-f50bd8a3-5267-40d6-80ab-dfdbd917a75d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:30.227855 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cf693d19-a3f0-4470-b661-b7ecba821a70 req-f50bd8a3-5267-40d6-80ab-dfdbd917a75d service neutron] 10.222.0.76 "GET /v2.0/networks?id=b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 200  len: 918 time: 0.1289952
May 25 16:42:30.299396 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cf693d19-a3f0-4470-b661-b7ecba821a70 req-5302dfd3-456d-41d9-b06e-ef0b307f8caf service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5c47c017-af78-4c20-a79c-f54715856946 HTTP/1.1" status: 200  len: 217 time: 0.0647652
May 25 16:42:30.371433 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf693d19-a3f0-4470-b661-b7ecba821a70 req-8d3b7a89-7eb6-4c8b-927e-cd0229c421c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:30.372868 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cf693d19-a3f0-4470-b661-b7ecba821a70 req-8d3b7a89-7eb6-4c8b-927e-cd0229c421c5 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=950695d6-8663-4ed4-92fd-b43d8ea5a820 HTTP/1.1" status: 200  len: 856 time: 0.0658894
May 25 16:42:30.458138 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf693d19-a3f0-4470-b661-b7ecba821a70 req-ccee29b6-b8e5-4a48-9ac3-b4191c1e89f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:30.459607 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cf693d19-a3f0-4470-b661-b7ecba821a70 req-ccee29b6-b8e5-4a48-9ac3-b4191c1e89f8 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b8cabc9a-0f6f-485c-8020-441b42ac019b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0784764
May 25 16:42:30.615141 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cf693d19-a3f0-4470-b661-b7ecba821a70 req-1ab2da2d-3f9d-4f0e-b432-dc0db289912f service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1469176
May 25 16:42:30.768195 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cf693d19-a3f0-4470-b661-b7ecba821a70 req-3968dc49-b4c1-4bbd-b5be-8dc452eda6fa service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1455033
May 25 16:42:30.995595 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0b36f9b-e9dc-42fc-8542-7cadd8e9d73e req-11dd0058-bacd-43f7-bf25-43955971053c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:30.997219 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b0b36f9b-e9dc-42fc-8542-7cadd8e9d73e req-11dd0058-bacd-43f7-bf25-43955971053c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.0868459
May 25 16:42:31.049017 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b0b36f9b-e9dc-42fc-8542-7cadd8e9d73e req-7c158c4d-7350-4e56-93c5-508e9416d2c2 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0455256
May 25 16:42:31.345074 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 5c47c017-af78-4c20-a79c-f54715856946 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:42:31.463911 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c4ac09b0-d06d-4e26-8852-e47f023c9319 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:31.490626 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 5c47c017-af78-4c20-a79c-f54715856946, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=5c47c017-af78-4c20-a79c-f54715856946,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:31.504011 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '5c47c017-af78-4c20-a79c-f54715856946', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'port_id': '5c47c017-af78-4c20-a79c-f54715856946', 'mac_address': 'fa:16:3e:0b:6e:97', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 414, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:42:31.563055 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:31.580745 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5c47c017-af78-4c20-a79c-f54715856946 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:42:31.598272 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 5c47c017-af78-4c20-a79c-f54715856946, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=5c47c017-af78-4c20-a79c-f54715856946,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:31.603361 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:31.605099 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-bcd58574-04d1-4158-98e3-16310c6d3670 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:31.671463 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=5c47c017-af78-4c20-a79c-f54715856946,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:31.674470 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:32.250925 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d0ba2f8-aee6-4584-9aef-7ab482e7e5b5 req-314a2dae-ae1a-4f7e-8dab-b91538a9a512 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:32.252562 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d0ba2f8-aee6-4584-9aef-7ab482e7e5b5 req-314a2dae-ae1a-4f7e-8dab-b91538a9a512 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 944 time: 0.0903251
May 25 16:42:32.298972 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d0ba2f8-aee6-4584-9aef-7ab482e7e5b5 req-db18cf37-eba6-42d1-aa13-92e54c8a6587 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0407703
May 25 16:42:33.488952 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2769a24-ca1e-4cfa-a15d-194af4d9db52 req-cb92d623-2867-44df-add9-2f0a3b00fcbb tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:33.490333 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c2769a24-ca1e-4cfa-a15d-194af4d9db52 req-cb92d623-2867-44df-add9-2f0a3b00fcbb tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 944 time: 0.0807300
May 25 16:42:33.537885 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c2769a24-ca1e-4cfa-a15d-194af4d9db52 req-923b9037-043f-489a-9774-cb4460567dfe tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0419574
May 25 16:42:33.845991 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:34.113129 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-5ce3df21-a944-4da4-810e-c9c60820044a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:34.734596 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5f2ae1-4b80-44ed-af67-ce054e3e9463 req-8f004181-8797-4bf7-952f-1c7ef10e2fed tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:34.736052 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4b5f2ae1-4b80-44ed-af67-ce054e3e9463 req-8f004181-8797-4bf7-952f-1c7ef10e2fed tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 944 time: 0.0853920
May 25 16:42:34.781545 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4b5f2ae1-4b80-44ed-af67-ce054e3e9463 req-9b614fb6-5093-44e3-a2fb-bb5852477f9c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0397484
May 25 16:42:34.909808 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['5c47c017-af78-4c20-a79c-f54715856946'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:42:35.068363 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:35.977656 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b538454-e0ec-45fb-bec3-7e8c366bb55a req-b79b77e1-26f7-48d9-809f-b31c6c75cef3 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:35.979114 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2b538454-e0ec-45fb-bec3-7e8c366bb55a req-b79b77e1-26f7-48d9-809f-b31c6c75cef3 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 944 time: 0.0874212
May 25 16:42:36.028033 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2b538454-e0ec-45fb-bec3-7e8c366bb55a req-b7388605-95f8-41bc-93c6-36c575012087 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0399845
May 25 16:42:36.569904 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:36.672907 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 5c47c017-af78-4c20-a79c-f54715856946 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:42:36.741201 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 5c47c017-af78-4c20-a79c-f54715856946 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:36.746486 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 5c47c017-af78-4c20-a79c-f54715856946 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:36.746853 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:36.869522 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:36.899802 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c47c017-af78-4c20-a79c-f54715856946'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:42:36.910414 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 5c47c017-af78-4c20-a79c-f54715856946, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=5c47c017-af78-4c20-a79c-f54715856946,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:36.916735 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:36.918816 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c42c7215-2a2c-4b61-8661-27e8ff6bf5d2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:36.996513 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c47c017-af78-4c20-a79c-f54715856946', 'code': 200}
May 25 16:42:37.028779 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=5c47c017-af78-4c20-a79c-f54715856946,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:37.036247 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:37.036589 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:37.036919 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:37.037244 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:37.037590 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:37.037912 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:37.038230 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:37.038589 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:37.038913 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:37.040641 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:37.040641 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:37.040641 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:37.043603 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:37.277791 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39fecbe1-a650-433e-b15b-62add57816e9 req-fe222d6b-5f39-40fa-82dc-ddcced146f64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:37.279227 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39fecbe1-a650-433e-b15b-62add57816e9 req-fe222d6b-5f39-40fa-82dc-ddcced146f64 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 1098 time: 0.1026647
May 25 16:42:37.287076 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7670b9d5-7ceb-445b-be11-0f0e647ef3fa req-12b95b92-5b99-43bb-9b16-f2bd4075f60a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:37.288448 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7670b9d5-7ceb-445b-be11-0f0e647ef3fa req-12b95b92-5b99-43bb-9b16-f2bd4075f60a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.1456432
May 25 16:42:37.367116 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39fecbe1-a650-433e-b15b-62add57816e9 req-ea0083b4-d1c7-412b-b889-95a9333634e8 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0777597
May 25 16:42:37.372571 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7670b9d5-7ceb-445b-be11-0f0e647ef3fa req-1e1b27f7-a656-42b8-9427-09dda20be257 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0709138
May 25 16:42:38.655982 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d6988c3-d791-4c98-a871-7031d063560f req-c8cc97c9-f0a0-4a2f-a317-6d2b349604d5 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:38.657448 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8d6988c3-d791-4c98-a871-7031d063560f req-c8cc97c9-f0a0-4a2f-a317-6d2b349604d5 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.1621945
May 25 16:42:38.702567 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8d6988c3-d791-4c98-a871-7031d063560f req-d53f5f34-b360-4700-9574-2c9b0a4ef322 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0394681
May 25 16:42:38.905071 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee4a7c3d-1fce-4a77-9f03-0c01f1b5108b req-7b389e06-2755-4f52-abb7-89826f2455f6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:38.906515 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ee4a7c3d-1fce-4a77-9f03-0c01f1b5108b req-7b389e06-2755-4f52-abb7-89826f2455f6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0793939
May 25 16:42:38.915744 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58550) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:38.921584 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-2b89c349-267d-495b-a998-941a740f8b94 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Request body: {'floatingip': {'port_id': '5c47c017-af78-4c20-a79c-f54715856946'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:39.001255 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2b89c349-267d-495b-a998-941a740f8b94 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:39.703060 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2b89c349-267d-495b-a998-941a740f8b94 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:39.708692 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2b89c349-267d-495b-a998-941a740f8b94 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:39.781170 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ecd692d1-03a1-4c15-92f8-6cb494350b03 req-89642e21-f458-4161-91c0-dc606d530cb5 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1259179
May 25 16:42:39.896713 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.l3_db [None req-2b89c349-267d-495b-a998-941a740f8b94 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Floating IP 52e4edda-6b53-4831-a933-8fabaef8ff01 associated. External IP: 172.27.3.99, port: 5c47c017-af78-4c20-a79c-f54715856946.
May 25 16:42:39.960550 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd692d1-03a1-4c15-92f8-6cb494350b03 req-37df43a0-fc83-4409-afce-bde9016a06f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:39.962067 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ecd692d1-03a1-4c15-92f8-6cb494350b03 req-37df43a0-fc83-4409-afce-bde9016a06f4 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a723bbfba23f463dbb8da0bdacb4b0aa&device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 1098 time: 0.1048496
May 25 16:42:40.124362 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd692d1-03a1-4c15-92f8-6cb494350b03 req-c9f9b776-e2ba-4897-875a-95dd70609413 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:40.125899 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ecd692d1-03a1-4c15-92f8-6cb494350b03 req-c9f9b776-e2ba-4897-875a-95dd70609413 service neutron] 10.222.0.76 "GET /v2.0/networks?id=3e40698a-e2cb-4812-9711-e3b481dbc8b3 HTTP/1.1" status: 200  len: 910 time: 0.1361680
May 25 16:42:40.238834 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ecd692d1-03a1-4c15-92f8-6cb494350b03 req-db8ed8c2-f6e9-437a-ac0e-163dffea8ce7 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba HTTP/1.1" status: 200  len: 1001 time: 0.1064057
May 25 16:42:40.279144 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2b89c349-267d-495b-a998-941a740f8b94 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:42:40.308096 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd692d1-03a1-4c15-92f8-6cb494350b03 req-10f49c30-2cdb-4378-8b66-ad5d963c922a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:40.309554 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ecd692d1-03a1-4c15-92f8-6cb494350b03 req-10f49c30-2cdb-4378-8b66-ad5d963c922a service neutron] 10.222.0.76 "GET /v2.0/subnets?id=6203ecab-ef7b-4872-ac7a-33ea4cfae323 HTTP/1.1" status: 200  len: 848 time: 0.0613580
May 25 16:42:40.386919 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd692d1-03a1-4c15-92f8-6cb494350b03 req-85940b00-4b55-4170-9b51-edeb1e5d090e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:40.388296 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ecd692d1-03a1-4c15-92f8-6cb494350b03 req-85940b00-4b55-4170-9b51-edeb1e5d090e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=3e40698a-e2cb-4812-9711-e3b481dbc8b3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0716581
May 25 16:42:40.465036 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2b89c349-267d-495b-a998-941a740f8b94 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:42:40.469824 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2b89c349-267d-495b-a998-941a740f8b94 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:40.482513 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d79efce0-65ac-4462-a030-e58db4a2960d None None] Sync routers for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:42:40.494859 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d79efce0-65ac-4462-a030-e58db4a2960d None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:40.495737 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d79efce0-65ac-4462-a030-e58db4a2960d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346a89e9d0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:42:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:40.528513 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-2b89c349-267d-495b-a998-941a740f8b94 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "PUT /v2.0/floatingips/52e4edda-6b53-4831-a933-8fabaef8ff01 HTTP/1.1" status: 200  len: 990 time: 1.6113896
May 25 16:42:40.530004 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'tag': '5c47c017-af78-4c20-a79c-f54715856946'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:42:40.539141 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ecd692d1-03a1-4c15-92f8-6cb494350b03 req-b32e9f6e-b0b2-4833-8659-dc593d5ee7af service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1428084
May 25 16:42:40.624902 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'tag': '5c47c017-af78-4c20-a79c-f54715856946', 'status': 'completed', 'code': 200}
May 25 16:42:40.695660 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-d79efce0-65ac-4462-a030-e58db4a2960d None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:40.701347 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ecd692d1-03a1-4c15-92f8-6cb494350b03 req-2ff8bd11-570a-4370-840f-2d0f23c9c002 service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1546636
May 25 16:42:41.046228 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d79efce0-65ac-4462-a030-e58db4a2960d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346a89e9d0>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '52e4edda-6b53-4831-a933-8fabaef8ff01', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'floating_ip_address': '172.27.3.99', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'port_id': '5c47c017-af78-4c20-a79c-f54715856946', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'mac_address': 'fa:16:3e:0b:6e:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:42:23Z', 'updated_at': '2021-05-25T16:42:39Z', 'revision_number': 1, 'project_id': '9c4a08443867402386f8ec58d2615739', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:59Z', 'revision_number': 5, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:41.050607 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d79efce0-65ac-4462-a030-e58db4a2960d None None] Checking router: c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:42:41.059328 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d79efce0-65ac-4462-a030-e58db4a2960d None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:42:41.059924 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d79efce0-65ac-4462-a030-e58db4a2960d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346a89e9d0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:42:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:41.235446 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-d79efce0-65ac-4462-a030-e58db4a2960d None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:42:41.579407 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d79efce0-65ac-4462-a030-e58db4a2960d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346a89e9d0>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '52e4edda-6b53-4831-a933-8fabaef8ff01', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'floating_ip_address': '172.27.3.99', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'port_id': '5c47c017-af78-4c20-a79c-f54715856946', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'mac_address': 'fa:16:3e:0b:6e:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:42:23Z', 'updated_at': '2021-05-25T16:42:39Z', 'revision_number': 1, 'project_id': '9c4a08443867402386f8ec58d2615739', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:59Z', 'revision_number': 5, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:42:41.583741 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d79efce0-65ac-4462-a030-e58db4a2960d None None] The sync data for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi is: [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '52e4edda-6b53-4831-a933-8fabaef8ff01', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'floating_ip_address': '172.27.3.99', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'port_id': '5c47c017-af78-4c20-a79c-f54715856946', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 536, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'mac_address': 'fa:16:3e:0b:6e:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:42:23Z', 'updated_at': '2021-05-25T16:42:39Z', 'revision_number': 1, 'project_id': '9c4a08443867402386f8ec58d2615739', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:59Z', 'revision_number': 5, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:42:41.775683 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8eae94b7-d723-4c18-9e08-016eef2be1cf None None] New status for floating IP 52e4edda-6b53-4831-a933-8fabaef8ff01: ACTIVE {{(pid=92015) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:42:43.576820 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45e82cb8-a309-4b57-b647-d4c8c316b3bb req-cf5c368e-8402-470f-8551-6a38d3835005 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:43.578334 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-45e82cb8-a309-4b57-b647-d4c8c316b3bb req-cf5c368e-8402-470f-8551-6a38d3835005 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9c4a08443867402386f8ec58d2615739&device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 1098 time: 0.0713425
May 25 16:42:43.713165 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45e82cb8-a309-4b57-b647-d4c8c316b3bb req-e7eb908d-eb90-4780-a19d-36f78ce91c80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:43.714642 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-45e82cb8-a309-4b57-b647-d4c8c316b3bb req-e7eb908d-eb90-4780-a19d-36f78ce91c80 service neutron] 10.222.0.76 "GET /v2.0/networks?id=b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 200  len: 918 time: 0.1289542
May 25 16:42:43.823133 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-45e82cb8-a309-4b57-b647-d4c8c316b3bb req-dfc2c349-1842-4243-bdca-8b15d0be18df service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5c47c017-af78-4c20-a79c-f54715856946 HTTP/1.1" status: 200  len: 1000 time: 0.0982704
May 25 16:42:43.899614 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45e82cb8-a309-4b57-b647-d4c8c316b3bb req-99110b6c-40f0-43f6-8736-bf522c886281 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:43.901198 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-45e82cb8-a309-4b57-b647-d4c8c316b3bb req-99110b6c-40f0-43f6-8736-bf522c886281 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=950695d6-8663-4ed4-92fd-b43d8ea5a820 HTTP/1.1" status: 200  len: 856 time: 0.0683851
May 25 16:42:43.999689 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45e82cb8-a309-4b57-b647-d4c8c316b3bb req-43ccd757-4452-45c4-8802-243aa7acb32e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:44.001169 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-45e82cb8-a309-4b57-b647-d4c8c316b3bb req-43ccd757-4452-45c4-8802-243aa7acb32e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b8cabc9a-0f6f-485c-8020-441b42ac019b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0855002
May 25 16:42:44.056138 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:44.153788 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-45e82cb8-a309-4b57-b647-d4c8c316b3bb req-97e4723e-8017-44b3-8fd9-faefc0faadaf service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1408329
May 25 16:42:44.390421 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-bfde2493-bb52-4e7e-b59e-2ad14dc1baa9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Synchronizing usage tracker for tenant:577d706beb414387a68972cf7e8d0285 on resource:security_group {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:42:44.423289 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-45e82cb8-a309-4b57-b647-d4c8c316b3bb req-9c1f0f21-89da-415f-8cac-fd014223ef8c service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2619777
May 25 16:42:44.432250 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-bfde2493-bb52-4e7e-b59e-2ad14dc1baa9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Unset dirty status for tenant:577d706beb414387a68972cf7e8d0285 on resource:security_group {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:42:44.433479 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-bfde2493-bb52-4e7e-b59e-2ad14dc1baa9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1587326533&fields=id&tenant_id=577d706beb414387a68972cf7e8d0285 HTTP/1.1" status: 200  len: 267 time: 0.1138513
May 25 16:42:44.508181 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:42:44.601220 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-561e77a0-1edf-4586-adb9-51ac12036a07 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:44.601811 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-561e77a0-1edf-4586-adb9-51ac12036a07 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Synchronizing usage tracker for tenant:577d706beb414387a68972cf7e8d0285 on resource:network {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:42:44.618838 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-561e77a0-1edf-4586-adb9-51ac12036a07 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Unset dirty status for tenant:577d706beb414387a68972cf7e8d0285 on resource:network {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:42:44.620085 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-561e77a0-1edf-4586-adb9-51ac12036a07 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 812 time: 0.1773734
May 25 16:42:44.637341 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-185b5de8-fc05-4c8b-b986-7e038459c106 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/quotas/577d706beb414387a68972cf7e8d0285 HTTP/1.1" status: 200  len: 375 time: 0.0102797
May 25 16:42:44.726075 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-01447281-b407-41b7-8971-24bf763187bd tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0845976
May 25 16:42:44.869002 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-d3a51f97-dc06-48b3-9eb3-4011388f20e0 service neutron] 10.222.0.73 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1299858
May 25 16:42:45.018251 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-09ecbc84-5964-4470-983a-414661d68365 service neutron] 10.222.0.73 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1426899
May 25 16:42:45.157445 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f01a36e3-7bfe-4fbc-972a-152875afe88a req-f7377b37-f870-4cce-96ed-88ade1039b15 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:45.158935 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f01a36e3-7bfe-4fbc-972a-152875afe88a req-f7377b37-f870-4cce-96ed-88ade1039b15 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.0807028
May 25 16:42:45.209135 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f01a36e3-7bfe-4fbc-972a-152875afe88a req-347d8ac0-e180-4ff3-90b5-cd6eec3e2989 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0445237
May 25 16:42:45.420217 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0a2e1d99-8810-441e-9519-78e3ed16a88e req-3e5baec8-00b0-4caa-a2e8-109cb10d50d6 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 210 time: 0.0423853
May 25 16:42:46.424000 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b403e39d-4990-465a-8b0b-c3e387382677 req-4ff47a23-dc6c-4740-8b45-7ddfdfb88bfd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:46.426019 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b403e39d-4990-465a-8b0b-c3e387382677 req-4ff47a23-dc6c-4740-8b45-7ddfdfb88bfd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.1096556
May 25 16:42:46.593245 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b403e39d-4990-465a-8b0b-c3e387382677 req-b248a896-3b9f-4cd1-b234-3a2c49b864ba tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1238585
May 25 16:42:46.599068 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-13a44ae5-517d-4608-8225-3fab178099c5 req-a8c4b37f-c4c0-4db0-88c3-74fbeaea8d02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 210 time: 0.0558918
May 25 16:42:46.626643 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-9a3ed1eb-7ec7-4d58-a397-aaa45dd10c04 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:46.628198 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-9a3ed1eb-7ec7-4d58-a397-aaa45dd10c04 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 812 time: 0.2422836
May 25 16:42:46.679372 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2f666408-977e-4719-8a69-eacbd032ac2d tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=577d706beb414387a68972cf7e8d0285 HTTP/1.1" status: 200  len: 380 time: 0.0407226
May 25 16:42:46.689199 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Request body: {'port': {'device_id': '9767fed9-aaa7-4205-9878-8d298d4d5801', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'admin_state_up': True, 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'security_groups': ['63866e13-b231-485d-a031-21b53f908d39']}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:46.827418 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:46.831719 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Usage tracker for resource:port and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:46.834553 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:46.840505 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:46.852821 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Made reservation on behalf of 577d706beb414387a68972cf7e8d0285 for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:42:46.856685 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:47.036489 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Allocated IP 172.20.0.14 (9c8cc949-bd51-40a0-bff3-5527e7341361/2f2f7850-0dc5-48dc-8602-816147b64784/0125dd82-e845-45e1-94c0-4e9afabfecdb) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:42:47.230413 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:47.246936 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Transition to ACTIVE for port object 0125dd82-e845-45e1-94c0-4e9afabfecdb will not be triggered until provisioned by entity DHCP. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:47.272064 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:47.278161 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9eb01af1-890f-455b-b6fb-ea505490e1b4 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:47.430523 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Network 9c8cc949-bd51-40a0-bff3-5527e7341361 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:42:47.434072 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:42:47.437909 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:42:47.487940 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'Port': ['ID=0125dd82-e845-45e1-94c0-4e9afabfecdb,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:47.501580 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:47.501954 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:47.502313 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:47.502706 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:47.503059 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:47.503413 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:47.503759 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:47.504105 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:47.504450 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:47.504791 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:47.505128 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:47.505491 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:47.511329 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:47.519928 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:47.520558 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:47.544092 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.8582807
May 25 16:42:47.556240 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Request body: {'port': {'device_id': '9767fed9-aaa7-4205-9878-8d298d4d5801', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:42:47.678379 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:47.678708 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-06254144-be68-44a0-a586-115943b86b31 None None] Provisioning for port 0125dd82-e845-45e1-94c0-4e9afabfecdb completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:42:47.685701 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-06254144-be68-44a0-a586-115943b86b31 None None] Provisioning complete for port 0125dd82-e845-45e1-94c0-4e9afabfecdb triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:42:47.686444 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-06254144-be68-44a0-a586-115943b86b31 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:47.748121 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-06254144-be68-44a0-a586-115943b86b31 None None] Port 0125dd82-e845-45e1-94c0-4e9afabfecdb cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:42:48.036235 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-886f6e41-e1a9-40c1-8f4c-1c60f2a17eb1 req-ed2dbcbf-1477-43f9-867a-0e1f4185e834 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:48.037693 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-886f6e41-e1a9-40c1-8f4c-1c60f2a17eb1 req-ed2dbcbf-1477-43f9-867a-0e1f4185e834 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.3084061
May 25 16:42:48.046998 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c72f04c-e5c2-42a1-8b5d-1921b00db9da req-c2cf4abc-b3c0-47b1-ac43-b9d28028190c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:48.047676 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-1c72f04c-e5c2-42a1-8b5d-1921b00db9da req-c2cf4abc-b3c0-47b1-ac43-b9d28028190c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Synchronizing usage tracker for tenant:577d706beb414387a68972cf7e8d0285 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:42:48.119589 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-1c72f04c-e5c2-42a1-8b5d-1921b00db9da req-c2cf4abc-b3c0-47b1-ac43-b9d28028190c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Unset dirty status for tenant:577d706beb414387a68972cf7e8d0285 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:42:48.120732 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1c72f04c-e5c2-42a1-8b5d-1921b00db9da req-c2cf4abc-b3c0-47b1-ac43-b9d28028190c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 932 time: 0.3806829
May 25 16:42:48.131912 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-886f6e41-e1a9-40c1-8f4c-1c60f2a17eb1 req-c61784ce-660a-463f-bf08-9b36265c3900 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0814397
May 25 16:42:48.190902 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1c72f04c-e5c2-42a1-8b5d-1921b00db9da req-219a63db-503d-4359-8f2c-d2784fb37b2c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0554371
May 25 16:42:48.277257 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0125dd82-e845-45e1-94c0-4e9afabfecdb {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:42:48.285894 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:48.302396 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Transition to ACTIVE for port object 0125dd82-e845-45e1-94c0-4e9afabfecdb will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:42:48.307412 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:48.312329 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:48.470977 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Pushing event updated for resources: {'Port': ['ID=0125dd82-e845-45e1-94c0-4e9afabfecdb,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:48.478937 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:48.553640 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Attempting to bind port 0125dd82-e845-45e1-94c0-4e9afabfecdb on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:42:48.553973 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Attempting to bind port 0125dd82-e845-45e1-94c0-4e9afabfecdb by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:42:48.554295 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Attempting to bind port 0125dd82-e845-45e1-94c0-4e9afabfecdb on network 9c8cc949-bd51-40a0-bff3-5527e7341361 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:42:48.559260 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Port 0125dd82-e845-45e1-94c0-4e9afabfecdb on network 9c8cc949-bd51-40a0-bff3-5527e7341361 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:42:48.559611 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Attempting to bind port 0125dd82-e845-45e1-94c0-4e9afabfecdb on network 9c8cc949-bd51-40a0-bff3-5527e7341361 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:42:48.564711 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 42, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:42:48.565096 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Checking segment: {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:42:48.566301 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Bound using segment: {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:42:48.566739 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Bound port: 0125dd82-e845-45e1-94c0-4e9afabfecdb, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:42:48.567085 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:48.654517 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] For port 0125dd82-e845-45e1-94c0-4e9afabfecdb, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:42:48.657353 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] For port 0125dd82-e845-45e1-94c0-4e9afabfecdb, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0125dd82-e845-45e1-94c0-4e9afabfecdb,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:42:48.662776 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:48.667143 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-89c359d8-0804-408a-acc0-92d0b422bb19 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:48.726248 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:48.726865 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:48.728414 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] 10.222.0.76 "PUT /v2.0/ports/0125dd82-e845-45e1-94c0-4e9afabfecdb HTTP/1.1" status: 200  len: 1094 time: 1.1766887
May 25 16:42:48.728941 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9767fed9-aaa7-4205-9878-8d298d4d5801', 'tag': '0125dd82-e845-45e1-94c0-4e9afabfecdb'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:42:48.752099 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Pushing event updated for resources: {'Port': ['ID=0125dd82-e845-45e1-94c0-4e9afabfecdb,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:48.756068 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:48.845485 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9767fed9-aaa7-4205-9878-8d298d4d5801', 'tag': '0125dd82-e845-45e1-94c0-4e9afabfecdb', 'status': 'completed', 'code': 200}
May 25 16:42:48.851989 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-32df6da7-bc3b-4c78-ae96-87afbac904c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:48.853496 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-32df6da7-bc3b-4c78-ae96-87afbac904c0 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 1097 time: 0.0808220
May 25 16:42:48.925837 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-affb16e5-6876-4cb5-8689-0c62bfb25a5d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0125dd82-e845-45e1-94c0-4e9afabfecdb HTTP/1.1" status: 200  len: 217 time: 0.0650001
May 25 16:42:48.990295 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-9cdb8a8e-cb3b-4aab-b631-05da00df32a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:48.991550 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-9cdb8a8e-cb3b-4aab-b631-05da00df32a5 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.0589569
May 25 16:42:49.071923 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-dca85438-d4ca-4bc7-8944-2498cf384e79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:49.073767 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-dca85438-d4ca-4bc7-8944-2498cf384e79 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0742929
May 25 16:42:49.380031 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-907d4690-3c4b-415b-9f40-52a0f14654ea service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2993464
May 25 16:42:49.536121 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0121ec2-166a-4e70-be51-400201994f33 req-5e0501fb-3d29-4132-aa77-7b8fccf35945 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:49.538388 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c0121ec2-166a-4e70-be51-400201994f33 req-5e0501fb-3d29-4132-aa77-7b8fccf35945 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.2751663
May 25 16:42:49.563025 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11c2d802-3046-4c93-a91d-44ad2f1d120c req-c9bd90ed-a13f-4c8b-bf21-3dd3878bcda2 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:49.564647 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-11c2d802-3046-4c93-a91d-44ad2f1d120c req-c9bd90ed-a13f-4c8b-bf21-3dd3878bcda2 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 944 time: 0.2602265
May 25 16:42:49.606499 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c4ed8e7-cc58-4895-b17e-26b8f252075c req-37f981d7-1ff1-4a5a-ae14-1309205e6a30 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2150297
May 25 16:42:49.639140 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c0121ec2-166a-4e70-be51-400201994f33 req-fc459d58-af5b-40d2-a510-fac86dcb8aa4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0923295
May 25 16:42:49.649861 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-11c2d802-3046-4c93-a91d-44ad2f1d120c req-55b0a4d5-f377-4c86-9aa0-76a68e70e410 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0671339
May 25 16:42:49.691077 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58686) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:49.753574 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ef4770-71a7-40f8-9fad-0c09ad533f89 req-537b1bd1-58c9-49db-b2f8-76eb77b5ddce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:49.755108 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a1ef4770-71a7-40f8-9fad-0c09ad533f89 req-537b1bd1-58c9-49db-b2f8-76eb77b5ddce service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 1097 time: 0.0937808
May 25 16:42:49.820273 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:49.834190 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:42:49.837988 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Usage tracker for resource:security_group_rule and tenant:5eba1fc7b24a48dda3f4499e3949d14d is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:42:49.840784 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:42:49.846552 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:42:49.895488 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ef4770-71a7-40f8-9fad-0c09ad533f89 req-439cec4d-270f-4b1c-8305-7fff3d985d02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:49.897046 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a1ef4770-71a7-40f8-9fad-0c09ad533f89 req-439cec4d-270f-4b1c-8305-7fff3d985d02 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 913 time: 0.1327856
May 25 16:42:49.933361 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:49.937478 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:49.946019 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-be70c0c0-7b5a-4ad2-93d8-6f4abb959bfe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:49.967786 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a1ef4770-71a7-40f8-9fad-0c09ad533f89 req-86712ae6-6799-4f5a-bd96-de06d76a7aab service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0125dd82-e845-45e1-94c0-4e9afabfecdb HTTP/1.1" status: 200  len: 217 time: 0.0637162
May 25 16:42:49.992401 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f69549b8-efa3-496d-8d95-2e888e1ae6b7,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:49.997928 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=5eba1fc7b24a48dda3f4499e3949d14d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3058751
May 25 16:42:50.000176 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58692) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:42:50.016592 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:50.016966 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:50.017331 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:50.017714 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:50.018121 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:50.018478 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:50.018827 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:50.019175 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:50.019526 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:50.019875 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:50.020220 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:50.020567 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:42:50.024513 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:50.039884 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ef4770-71a7-40f8-9fad-0c09ad533f89 req-9063fc26-06cf-4196-b9d7-72150391a010 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:50.042144 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a1ef4770-71a7-40f8-9fad-0c09ad533f89 req-9063fc26-06cf-4196-b9d7-72150391a010 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.0649476
May 25 16:42:50.075118 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f9aaeea8-cf4a-4932-a35c-2f54811916a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:50.102260 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f9aaeea8-cf4a-4932-a35c-2f54811916a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:50.122968 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ef4770-71a7-40f8-9fad-0c09ad533f89 req-1969393d-7350-498c-a980-2a44ea8dfa33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:50.124440 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a1ef4770-71a7-40f8-9fad-0c09ad533f89 req-1969393d-7350-498c-a980-2a44ea8dfa33 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0752673
May 25 16:42:50.155002 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f9aaeea8-cf4a-4932-a35c-2f54811916a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:50.159943 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-795e514a-371a-4695-82e8-304cbb338ad4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:50.172835 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9aaeea8-cf4a-4932-a35c-2f54811916a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f69549b8-efa3-496d-8d95-2e888e1ae6b7,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:50.175444 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f9aaeea8-cf4a-4932-a35c-2f54811916a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:50.176688 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f9aaeea8-cf4a-4932-a35c-2f54811916a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:50.180586 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f9aaeea8-cf4a-4932-a35c-2f54811916a9 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/f69549b8-efa3-496d-8d95-2e888e1ae6b7 HTTP/1.1" status: 204  len: 168 time: 0.1794767
May 25 16:42:50.271258 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a1ef4770-71a7-40f8-9fad-0c09ad533f89 req-d4429ebe-6dbb-4226-887c-9f1a775295d8 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1346495
May 25 16:42:50.406918 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a1ef4770-71a7-40f8-9fad-0c09ad533f89 req-2529f497-10d2-4a5a-bee9-87db39df10a2 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1282167
May 25 16:42:50.913714 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1df317d-5d5f-442e-a20c-06c75a62bd14 req-98e37fbb-92f9-4082-88b5-3e6b2491e466 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:50.915618 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e1df317d-5d5f-442e-a20c-06c75a62bd14 req-98e37fbb-92f9-4082-88b5-3e6b2491e466 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.1506183
May 25 16:42:50.923773 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61d34205-d112-4a4c-a1fe-ebd00d883970 req-4200d73f-1ec6-4eb8-9f33-8d6aa733cb97 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:50.925825 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-61d34205-d112-4a4c-a1fe-ebd00d883970 req-4200d73f-1ec6-4eb8-9f33-8d6aa733cb97 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 944 time: 0.1302555
May 25 16:42:50.998773 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e1df317d-5d5f-442e-a20c-06c75a62bd14 req-98269567-4a9e-431a-919a-c3dae80d8645 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0700514
May 25 16:42:51.004233 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-61d34205-d112-4a4c-a1fe-ebd00d883970 req-28c4175b-90b2-4f5b-b25a-c80e699d30a4 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0630045
May 25 16:42:52.246854 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9da4ca5-f4e2-4e35-a0d7-2988718c9f12 req-f7292b5c-9551-4f6f-85b8-b933b91e3c1f tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:52.248303 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a9da4ca5-f4e2-4e35-a0d7-2988718c9f12 req-f7292b5c-9551-4f6f-85b8-b933b91e3c1f tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.1389608
May 25 16:42:52.260710 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-753fb3aa-def2-44cc-844b-170f0321ff04 req-f0c9c817-7e75-4592-b137-f36e427968bc tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:52.262119 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-753fb3aa-def2-44cc-844b-170f0321ff04 req-f0c9c817-7e75-4592-b137-f36e427968bc tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 944 time: 0.1180792
May 25 16:42:52.332568 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a9da4ca5-f4e2-4e35-a0d7-2988718c9f12 req-646880db-449f-4313-b076-55e4aec796f4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0695238
May 25 16:42:52.337432 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-753fb3aa-def2-44cc-844b-170f0321ff04 req-67e996a4-8c38-4e0d-9282-12a57c429a78 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0615172
May 25 16:42:53.664813 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5bb5072-79ab-475f-a9d8-13dce836664a req-44d4917d-8ab1-4f7a-9c5a-af5fd8da3b26 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:53.666220 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d5bb5072-79ab-475f-a9d8-13dce836664a req-44d4917d-8ab1-4f7a-9c5a-af5fd8da3b26 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.2220287
May 25 16:42:53.674769 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faf35120-8e5f-4bb2-b2a9-17d704055a37 req-294f6f01-c0b0-49d4-a642-52ad720c0100 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:53.676088 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-faf35120-8e5f-4bb2-b2a9-17d704055a37 req-294f6f01-c0b0-49d4-a642-52ad720c0100 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 944 time: 0.2006893
May 25 16:42:53.744778 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d5bb5072-79ab-475f-a9d8-13dce836664a req-4284bad5-0d38-48dc-a69a-02f5879fee31 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0677567
May 25 16:42:53.749179 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-faf35120-8e5f-4bb2-b2a9-17d704055a37 req-5e873911-78a6-4328-a6be-b8f8a2074e1d tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0594330
May 25 16:42:56.356039 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92c54bc-a556-4a12-a5a3-d1a4e3e47289 req-dc363f87-8436-4af9-a896-43944e4a82ab tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:56.357385 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d92c54bc-a556-4a12-a5a3-d1a4e3e47289 req-dc363f87-8436-4af9-a896-43944e4a82ab tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.1414325
May 25 16:42:56.365078 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66d40265-4aaf-4488-877a-70d433897f9a req-1a3e78b0-9468-47ae-8129-ad6293b7efc6 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:56.366408 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-66d40265-4aaf-4488-877a-70d433897f9a req-1a3e78b0-9468-47ae-8129-ad6293b7efc6 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 944 time: 0.1487095
May 25 16:42:56.441674 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d92c54bc-a556-4a12-a5a3-d1a4e3e47289 req-ade63ca8-3f36-4bb1-a40e-0aa177ea0b9c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0743074
May 25 16:42:56.446523 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-66d40265-4aaf-4488-877a-70d433897f9a req-dfac6058-eb84-4fa0-8a92-44fdfcd196e8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0657423
May 25 16:42:57.697968 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efa7f8a8-be80-4024-b6b8-5b3737ed75eb req-b475b318-ceb7-44f1-9d55-1537c1e51201 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:57.699401 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-efa7f8a8-be80-4024-b6b8-5b3737ed75eb req-b475b318-ceb7-44f1-9d55-1537c1e51201 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 944 time: 0.1412082
May 25 16:42:57.709317 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b34bb4d-c69e-42dd-aad5-f55f4b094a82 req-cd7d316d-ba05-4ad2-8731-7d3baff9e9de tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:57.710667 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b34bb4d-c69e-42dd-aad5-f55f4b094a82 req-cd7d316d-ba05-4ad2-8731-7d3baff9e9de tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.1143847
May 25 16:42:57.783180 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-efa7f8a8-be80-4024-b6b8-5b3737ed75eb req-0b344b1e-8e86-4fa2-88c4-619cb1df1722 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0714152
May 25 16:42:57.786237 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b34bb4d-c69e-42dd-aad5-f55f4b094a82 req-d4ba5207-3e6e-48f6-8ff2-7e6e7e41889d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0610113
May 25 16:42:58.783355 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 0125dd82-e845-45e1-94c0-4e9afabfecdb details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:42:58.926785 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 0125dd82-e845-45e1-94c0-4e9afabfecdb, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0125dd82-e845-45e1-94c0-4e9afabfecdb,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:58.944073 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '0125dd82-e845-45e1-94c0-4e9afabfecdb', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'port_id': '0125dd82-e845-45e1-94c0-4e9afabfecdb', 'mac_address': 'fa:16:3e:ba:25:a3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 435, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:42:59.029036 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:59.041311 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdeb3ca1-2189-4906-924d-593aadf2b7ea req-a36a5900-814d-4696-b469-b4b5239545a5 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:59.042815 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fdeb3ca1-2189-4906-924d-593aadf2b7ea req-a36a5900-814d-4696-b469-b4b5239545a5 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.1463468
May 25 16:42:59.045743 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0125dd82-e845-45e1-94c0-4e9afabfecdb {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:42:59.050814 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f79a10dd-6c50-45dc-9877-c954ea88ad61 req-059963c0-0997-45aa-a2e6-6bc1ac98ef48 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:42:59.052172 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f79a10dd-6c50-45dc-9877-c954ea88ad61 req-059963c0-0997-45aa-a2e6-6bc1ac98ef48 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 944 time: 0.1197858
May 25 16:42:59.062788 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 0125dd82-e845-45e1-94c0-4e9afabfecdb, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0125dd82-e845-45e1-94c0-4e9afabfecdb,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:42:59.067473 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:42:59.070330 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:42:59.123079 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fdeb3ca1-2189-4906-924d-593aadf2b7ea req-aa00cba9-4a7e-4269-9b73-e19dc0983729 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0699553
May 25 16:42:59.129330 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f79a10dd-6c50-45dc-9877-c954ea88ad61 req-4b49cfa2-0aaa-4b3f-baea-e780bbe7cd8f tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0600276
May 25 16:42:59.144392 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=0125dd82-e845-45e1-94c0-4e9afabfecdb,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:42:59.147510 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:42:59.319141 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['0125dd82-e845-45e1-94c0-4e9afabfecdb'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:42:59.895826 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58814) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:00.014470 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6ab14bbd-070a-45f4-8975-a013514379e1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:00.028944 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-6ab14bbd-070a-45f4-8975-a013514379e1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:43:00.032694 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-6ab14bbd-070a-45f4-8975-a013514379e1 admin admin] Usage tracker for resource:security_group_rule and tenant:95f02e03d01f418fba8ebf8acdd3a8ba is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:43:00.036251 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-6ab14bbd-070a-45f4-8975-a013514379e1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:43:00.041899 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-6ab14bbd-070a-45f4-8975-a013514379e1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:43:00.125365 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6ab14bbd-070a-45f4-8975-a013514379e1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:00.129948 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6ab14bbd-070a-45f4-8975-a013514379e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:00.138235 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-16855aa7-6749-4070-8c1d-1e4ec9021ea5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:00.199752 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-6ab14bbd-070a-45f4-8975-a013514379e1 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=95f02e03d01f418fba8ebf8acdd3a8ba&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3004715
May 25 16:43:00.199752 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ab14bbd-070a-45f4-8975-a013514379e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd20ef07-c91c-467a-94b5-f9bfb5852bb1,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:00.200216 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58824) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:00.202044 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-6ab14bbd-070a-45f4-8975-a013514379e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:00.343427 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-027d0088-7104-4b32-b9da-33161338b2dd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:00.400833 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-027d0088-7104-4b32-b9da-33161338b2dd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:00.468170 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76e345bf-112a-449b-aed1-861c4eccea07 req-5aea07db-1b84-4346-a90a-bdc25d520f20 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:00.469557 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-76e345bf-112a-449b-aed1-861c4eccea07 req-5aea07db-1b84-4346-a90a-bdc25d520f20 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 945 time: 0.1734483
May 25 16:43:00.477526 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a56919cb-64e1-477b-adab-3bccfb44e2a4 req-2401720c-eac3-4daf-8075-da6d1f772e40 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:00.478821 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a56919cb-64e1-477b-adab-3bccfb44e2a4 req-2401720c-eac3-4daf-8075-da6d1f772e40 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.2195647
May 25 16:43:00.546251 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-027d0088-7104-4b32-b9da-33161338b2dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:00.554502 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-0cac2f96-01b5-47ac-87d9-6c736278517f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:00.566606 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-76e345bf-112a-449b-aed1-861c4eccea07 req-d7ef2ea7-469f-4823-8d85-07a5c9805671 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0862272
May 25 16:43:00.575777 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a56919cb-64e1-477b-adab-3bccfb44e2a4 req-5c1bab08-2b03-4f48-9413-0012a2d5137e tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0821393
May 25 16:43:00.577766 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-027d0088-7104-4b32-b9da-33161338b2dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd20ef07-c91c-467a-94b5-f9bfb5852bb1,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:00.581555 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-027d0088-7104-4b32-b9da-33161338b2dd admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:00.582624 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-027d0088-7104-4b32-b9da-33161338b2dd admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/bd20ef07-c91c-467a-94b5-f9bfb5852bb1 HTTP/1.1" status: 204  len: 168 time: 0.3815138
May 25 16:43:00.592322 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-027d0088-7104-4b32-b9da-33161338b2dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:00.812574 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 0125dd82-e845-45e1-94c0-4e9afabfecdb up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:00.921558 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 0125dd82-e845-45e1-94c0-4e9afabfecdb completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:43:00.929730 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 0125dd82-e845-45e1-94c0-4e9afabfecdb triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:00.930142 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:01.057748 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:01.092300 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9767fed9-aaa7-4205-9878-8d298d4d5801', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0125dd82-e845-45e1-94c0-4e9afabfecdb'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:43:01.103252 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 0125dd82-e845-45e1-94c0-4e9afabfecdb, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0125dd82-e845-45e1-94c0-4e9afabfecdb,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:01.110761 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:01.115222 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-cd7d475c-68b5-498f-bdb2-2234f121b73d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:01.157075 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9767fed9-aaa7-4205-9878-8d298d4d5801', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0125dd82-e845-45e1-94c0-4e9afabfecdb', 'code': 200}
May 25 16:43:01.196729 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=0125dd82-e845-45e1-94c0-4e9afabfecdb,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:01.200483 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:01.335952 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbada670-b971-4f08-b58e-8d39adae090b req-c021fa59-3cae-4543-b876-54bc78e7f2c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:01.337911 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cbada670-b971-4f08-b58e-8d39adae090b req-c021fa59-3cae-4543-b876-54bc78e7f2c1 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a723bbfba23f463dbb8da0bdacb4b0aa&device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 1098 time: 0.0786688
May 25 16:43:01.348370 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58854) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:01.416742 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-1823946a-923e-4faa-963c-80cc658ab8be None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:01.468174 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-2100473491-network', 'tenant_id': '99ba5095326e4a449eb209304e90545f'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:43:01.474099 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:43:01.479201 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Usage tracker for resource:network and tenant:99ba5095326e4a449eb209304e90545f is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:43:01.482363 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:43:01.491949 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:43:01.502371 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Made reservation on behalf of 99ba5095326e4a449eb209304e90545f for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:43:01.504889 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:01.517879 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:01.532671 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:43:01.536943 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Usage tracker for resource:security_group_rule and tenant:99ba5095326e4a449eb209304e90545f is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:43:01.541832 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:43:01.548385 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:43:01.550012 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbada670-b971-4f08-b58e-8d39adae090b req-f902a72f-2434-4de7-a095-cb17f00a05e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:01.551469 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cbada670-b971-4f08-b58e-8d39adae090b req-f902a72f-2434-4de7-a095-cb17f00a05e8 service neutron] 10.222.0.76 "GET /v2.0/networks?id=3e40698a-e2cb-4812-9711-e3b481dbc8b3 HTTP/1.1" status: 200  len: 910 time: 0.2058864
May 25 16:43:01.557255 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c44481c-db13-4164-80f4-e0a8807da318 req-be5076ca-4086-4e67-b889-5d1102320aa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:01.557787 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c44481c-db13-4164-80f4-e0a8807da318 req-be5076ca-4086-4e67-b889-5d1102320aa5 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 1099 time: 0.1804268
May 25 16:43:01.686599 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:01.690602 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c44481c-db13-4164-80f4-e0a8807da318 req-8d84a141-edaa-44e2-a75d-f846940a763a service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0756948
May 25 16:43:01.692490 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cbada670-b971-4f08-b58e-8d39adae090b req-2361717a-f84a-48d2-9fd3-828d544e197d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba HTTP/1.1" status: 200  len: 1001 time: 0.1337683
May 25 16:43:01.694897 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:01.702185 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ff74238a-85d0-4482-beb5-0a358db25158 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:01.746308 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 432}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:43:01.767972 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87adbc8b-3d4f-4d64-a49b-750ed4406f55,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:01.774622 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:01.776505 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:01.777070 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Added segment 2de50154-f13b-406e-b119-a40fe0f3910b of type vlan for network b95afcbb-a35f-4e21-a67d-e6712b2de87f
May 25 16:43:01.813359 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:01.846771 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:01.847983 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:01.848584 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:01.851900 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-02f0a9f5-ccb5-4036-a95b-fd3dddf9530d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:01.912606 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbada670-b971-4f08-b58e-8d39adae090b req-22ae8e64-5d86-440a-b5fe-56d5090dbf00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:01.914068 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cbada670-b971-4f08-b58e-8d39adae090b req-22ae8e64-5d86-440a-b5fe-56d5090dbf00 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=6203ecab-ef7b-4872-ac7a-33ea4cfae323 HTTP/1.1" status: 200  len: 848 time: 0.1344609
May 25 16:43:02.061640 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Pushing event updated for resources: {'Network': ['ID=b95afcbb-a35f-4e21-a67d-e6712b2de87f,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:02.066135 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:02.072596 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 0.7230592
May 25 16:43:02.075526 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58868) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:02.075680 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network b95afcbb-a35f-4e21-a67d-e6712b2de87f details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:43:02.081585 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Request body: {'subnet': {'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-2100473491-subnet', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'ip_version': 4}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:43:02.086552 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:43:02.090984 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Usage tracker for resource:subnet and tenant:99ba5095326e4a449eb209304e90545f is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:43:02.093895 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:43:02.096055 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4892c1c4-1ca1-432a-bc3b-51828bcf3515 req-9463f4d3-214a-4bff-a25d-abad91141832 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:02.097540 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4892c1c4-1ca1-432a-bc3b-51828bcf3515 req-9463f4d3-214a-4bff-a25d-abad91141832 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.3510771
May 25 16:43:02.100452 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:43:02.107043 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9167beca-6fef-43cb-b123-ef76f42d6734 req-cc6430f6-e392-43a7-8681-f6ad03be7999 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:02.108661 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9167beca-6fef-43cb-b123-ef76f42d6734 req-cc6430f6-e392-43a7-8681-f6ad03be7999 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 946 time: 0.2836759
May 25 16:43:02.116160 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Made reservation on behalf of 99ba5095326e4a449eb209304e90545f for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:43:02.118734 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-697612'] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:02.183671 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbada670-b971-4f08-b58e-8d39adae090b req-f71e2e91-f824-494e-af03-8c03bffdf0fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:02.185133 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cbada670-b971-4f08-b58e-8d39adae090b req-f71e2e91-f824-494e-af03-8c03bffdf0fa service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=3e40698a-e2cb-4812-9711-e3b481dbc8b3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2640495
May 25 16:43:02.203269 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4892c1c4-1ca1-432a-bc3b-51828bcf3515 req-ec65b54d-34da-47ee-a68a-25d4274fc4df tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0918455
May 25 16:43:02.245362 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9167beca-6fef-43cb-b123-ef76f42d6734 req-845484c8-0480-4938-b4aa-5e07fbe507db tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1166451
May 25 16:43:02.376378 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cbada670-b971-4f08-b58e-8d39adae090b req-09b598b0-7ea0-4054-a7b4-ab6d66b4bc90 service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1716321
May 25 16:43:02.536295 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cbada670-b971-4f08-b58e-8d39adae090b req-18484546-dee9-46da-96b7-7fbbb0c40d37 service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1527526
May 25 16:43:02.569989 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7721570', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-697626'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:02.575044 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:02.647979 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8641bb52-68d1-4215-b71c-1965a76b5e66,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:02.651329 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:02.657173 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Checking segment: {'id': '2de50154-f13b-406e-b119-a40fe0f3910b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:43:02.657560 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Network hostable DHCP agents. Network: b95afcbb-a35f-4e21-a67d-e6712b2de87f, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:43:02.674547 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Network b95afcbb-a35f-4e21-a67d-e6712b2de87f is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:43:02.684343 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, b95afcbb-a35f-4e21-a67d-e6712b2de87f) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:43:02.694330 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:02.695039 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:02.696121 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd423c72-a135-4ecf-a8d4-1e7fa4676363 None None] Network b95afcbb-a35f-4e21-a67d-e6712b2de87f requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:43:02.716085 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-b7586fec-9476-406f-b69c-3767a09a26a1 admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 0.6395085
May 25 16:43:02.718624 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58872) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:02.723798 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:43:02.728464 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:43:02.732223 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Usage tracker for resource:router and tenant:99ba5095326e4a449eb209304e90545f is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:43:02.735067 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:43:02.741185 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:43:02.753824 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-506971', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2375'] for router, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:02.754900 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-504667', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-501124', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1593705', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2380'] for router, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:02.770429 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:02.912556 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d60576c-5158-50e8-99d6-6272b1af5e3f-b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'fixed_ips': [{'subnet_id': '8641bb52-68d1-4215-b71c-1965a76b5e66'}]}} from dv-cinder-786386-6-iscsi. {{(pid=92014) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 16:43:02.913410 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:03.040703 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-501153', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-506985', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2362'] for router, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:03.072239 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.db_base_plugin_common [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Allocated IP 172.20.0.2 (b95afcbb-a35f-4e21-a67d-e6712b2de87f/8641bb52-68d1-4215-b71c-1965a76b5e66/4409a694-0319-4856-8e61-a5629373a62e) {{(pid=92014) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:43:03.289576 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Notify callbacks [] for port, precommit_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:03.299793 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Transition to ACTIVE for port object 4409a694-0319-4856-8e61-a5629373a62e will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:43:03.320821 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Transition to ACTIVE for port object 4409a694-0319-4856-8e61-a5629373a62e will not be triggered until provisioned by entity DHCP. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:43:03.326897 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:03.332261 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:03.363090 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:03.407107 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:03.428678 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Network b95afcbb-a35f-4e21-a67d-e6712b2de87f is already hosted by enough agents. {{(pid=92014) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:43:03.432877 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.base_scheduler [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Resources bound (agent type, host, resource id):  {{(pid=92014) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:43:03.435837 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Received port after_create {{(pid=92014) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:43:03.445182 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Pushing event updated for resources: {'Port': ['ID=4409a694-0319-4856-8e61-a5629373a62e,revision_number=1']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:03.479938 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:03.482898 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29e2999d-d7f1-4902-bf4d-6affc01a53a7 req-a6891299-4fe7-4ba5-adf0-da99a8a1b6e1 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:03.484562 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-29e2999d-d7f1-4902-bf4d-6affc01a53a7 req-a6891299-4fe7-4ba5-adf0-da99a8a1b6e1 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.1581769
May 25 16:43:03.514175 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dabd237d-8da1-4c7e-8199-944e0b5ab8a4 req-4bb28310-c416-4384-a1be-be3fe518bf35 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:03.515573 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dabd237d-8da1-4c7e-8199-944e0b5ab8a4 req-4bb28310-c416-4384-a1be-be3fe518bf35 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 946 time: 0.1230569
May 25 16:43:03.550770 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Attempting to bind port 4409a694-0319-4856-8e61-a5629373a62e on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:43:03.551173 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Attempting to bind port 4409a694-0319-4856-8e61-a5629373a62e by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '2de50154-f13b-406e-b119-a40fe0f3910b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:43:03.551504 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Attempting to bind port 4409a694-0319-4856-8e61-a5629373a62e on network b95afcbb-a35f-4e21-a67d-e6712b2de87f {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:43:03.557804 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 42, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:43:03.558244 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Checking segment: {'id': '2de50154-f13b-406e-b119-a40fe0f3910b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:43:03.558580 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:03.558987 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Bound using segment: {'id': '2de50154-f13b-406e-b119-a40fe0f3910b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:43:03.559739 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Bound port: 4409a694-0319-4856-8e61-a5629373a62e, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2de50154-f13b-406e-b119-a40fe0f3910b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:43:03.559954 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:03.582694 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-29e2999d-d7f1-4902-bf4d-6affc01a53a7 req-7f2e7639-dba2-4d69-9261-d3bcefc6d6f7 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0907903
May 25 16:43:03.606712 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dabd237d-8da1-4c7e-8199-944e0b5ab8a4 req-63f7dd78-e054-4294-89c3-10a0e47cc060 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0739007
May 25 16:43:03.669428 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Allocated IP 172.27.3.97 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/7734ff45-2516-4b7e-bd97-3e1c727bd6b1) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:43:03.670367 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] For port 4409a694-0319-4856-8e61-a5629373a62e, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:43:03.673590 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] For port 4409a694-0319-4856-8e61-a5629373a62e, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=4409a694-0319-4856-8e61-a5629373a62e,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:43:03.679504 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:03.685698 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:03.769017 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Pushing event updated for resources: {'Port': ['ID=4409a694-0319-4856-8e61-a5629373a62e,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:03.772224 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:03.839607 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:03.848786 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:03.886972 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:03.895852 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c5cc8f72-aebb-4de7-8dc4-7ce8556b2a86 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:03.957730 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:43:03.961313 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:43:03.965376 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:43:03.968594 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07684286-3be6-4163-bbf6-b933ef35c9df req-a37a3c62-89ed-4a99-a5f9-d627f6dd6ffa tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:03.970242 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-07684286-3be6-4163-bbf6-b933ef35c9df req-a37a3c62-89ed-4a99-a5f9-d627f6dd6ffa tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 946 time: 0.0973248
May 25 16:43:04.047001 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-07684286-3be6-4163-bbf6-b933ef35c9df req-85e8d8df-5cf7-4726-bfcd-a79b5066ddaf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0706465
May 25 16:43:04.058002 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Pushing event updated for resources: {'Port': ['ID=7734ff45-2516-4b7e-bd97-3e1c727bd6b1,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:04.062270 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:04.073797 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58890) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:04.113680 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-ae650021-682d-4116-b748-2e3004b1d471 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:04.297189 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18cc61f3-598c-451a-a559-3c2ec186b094 tempest-TestVolumeBootPattern-836350970 tempest-TestVolumeBootPattern-836350970-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:04.298788 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-18cc61f3-598c-451a-a559-3c2ec186b094 tempest-TestVolumeBootPattern-836350970 tempest-TestVolumeBootPattern-836350970-project-admin] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 1094 time: 0.2239978
May 25 16:43:04.302507 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58896) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:04.310668 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Request body: {'floatingip': {'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'port_id': '0125dd82-e845-45e1-94c0-4e9afabfecdb', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address': '172.20.0.14'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:43:04.319304 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:43:04.328081 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Usage tracker for resource:floatingip and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:43:04.334863 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:43:04.343671 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:43:04.434079 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for floatingip, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:04.645809 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:04.862181 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:04.863081 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a3234c7-9e48-4870-ac82-022ec507c49b req-31d1352b-e5ab-4dc5-8f93-39842466c436 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:04.864689 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3a3234c7-9e48-4870-ac82-022ec507c49b req-31d1352b-e5ab-4dc5-8f93-39842466c436 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.1588922
May 25 16:43:04.925976 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7ef82b2-7f24-40a6-8a6c-07770933a9a0 None None] Network b95afcbb-a35f-4e21-a67d-e6712b2de87f requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:43:04.926482 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3a3234c7-9e48-4870-ac82-022ec507c49b req-120d0205-0493-4554-99bb-9425110e161a tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0532157
May 25 16:43:05.060111 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-ca9346af-88cb-457f-8bc4-2785f3ecade0 None None] Provisioning for port 4409a694-0319-4856-8e61-a5629373a62e completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:43:05.094429 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:05.162641 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-506962', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-501218'] for router, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:05.244155 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 4409a694-0319-4856-8e61-a5629373a62e up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:05.320498 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 4409a694-0319-4856-8e61-a5629373a62e completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:43:05.325981 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 4409a694-0319-4856-8e61-a5629373a62e triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:05.326357 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:05.350608 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Allocated IP 172.27.3.243 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/8a7ed039-17bb-4a1b-87b4-993c28f055f7) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:43:05.477435 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:05.520678 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-45192e7e-efee-4420-b16a-b503af78bcc8 None None] Provisioning complete for port 4409a694-0319-4856-8e61-a5629373a62e triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:05.521002 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-45192e7e-efee-4420-b16a-b503af78bcc8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:05.577955 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 4409a694-0319-4856-8e61-a5629373a62e, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=4409a694-0319-4856-8e61-a5629373a62e,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:05.586340 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:05.590269 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:05.642589 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:05.663240 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 is scheduled to L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 with binding_index 1 {{(pid=92012) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 16:43:05.717013 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=4409a694-0319-4856-8e61-a5629373a62e,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:05.724313 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:05.765790 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:05.772211 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2158bc77-aeb7-4851-bbc0-615c29faf56c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:05.914488 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:43:05.919779 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:43:05.922242 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:43:05.962769 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'Port': ['ID=8a7ed039-17bb-4a1b-87b4-993c28f055f7,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:05.965760 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:05.994113 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:43:06.016586 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Sync routers for ids ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:43:06.023824 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Routers {'eedeb3fa-21be-40a8-bc7a-e35e532db9c4'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:06.024613 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bb92340>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:06.090782 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] Notify callbacks [] for router, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:06.094574 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-fd894fac-ce74-40d7-8e48-9004a85af319 admin admin] 10.222.0.73 "POST /v2.0/routers HTTP/1.1" status: 201  len: 926 time: 3.3725049
May 25 16:43:06.094924 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58924) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:06.233013 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Set router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:06.455056 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:06.484024 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06bee061-9c80-4847-a61b-ba34b82498fb req-d18a9927-345d-468c-8ae9-3e20063d26d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:06.485575 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-06bee061-9c80-4847-a61b-ba34b82498fb req-d18a9927-345d-468c-8ae9-3e20063d26d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.2805061
May 25 16:43:06.553519 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:06.570529 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bb92340>, [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97'}], 'enable_snat': True}, 'gw_port_id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:43:04Z', 'revision_number': 3, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port': {'id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:29:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:03Z', 'updated_at': '2021-05-25T16:43:03Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:06.579955 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Checking router: eedeb3fa-21be-40a8-bc7a-e35e532db9c4 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:43:06.581198 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Updating router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 port 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 binding host dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:43:06.637827 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-06bee061-9c80-4847-a61b-ba34b82498fb req-d807e2bc-e7c4-4078-a5e2-6ea084c6b9be tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1437724
May 25 16:43:06.671280 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:06.677433 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:06.839589 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:06.844806 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:06.850413 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3753cbff-ff4e-425c-a7ed-d3872eb1d919 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:07.018351 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:07.091656 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Notify callbacks [] for port, precommit_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:07.108402 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Transition to ACTIVE for port object 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:43:07.119085 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:07.125728 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:07.263688 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1078589c-a2d5-44c6-bd05-f47ca411f445 req-3ba91e56-7945-4800-8ca1-f2a1c9ef3c72 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:07.265165 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1078589c-a2d5-44c6-bd05-f47ca411f445 req-3ba91e56-7945-4800-8ca1-f2a1c9ef3c72 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.1859486
May 25 16:43:07.286119 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-107a4ece-39fa-44a4-98fa-e9d5f07ffeea None None] Pushing event updated for resources: {'Port': ['ID=7734ff45-2516-4b7e-bd97-3e1c727bd6b1,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:07.290151 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'Port': ['ID=8a7ed039-17bb-4a1b-87b4-993c28f055f7,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:07.292728 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 4409a694-0319-4856-8e61-a5629373a62e up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:07.293198 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.443s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:07.324780 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:07.340506 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-107a4ece-39fa-44a4-98fa-e9d5f07ffeea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:07.350797 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1078589c-a2d5-44c6-bd05-f47ca411f445 req-84568db4-ec9a-4f48-af4b-8f07ff0d0152 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0712972
May 25 16:43:07.381454 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Attempting to bind port 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:43:07.381454 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Attempting to bind port 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:43:07.381454 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Attempting to bind port 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 on network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:43:07.393831 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 43, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:43:07.394217 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Checking segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:43:07.394626 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:07.395022 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Bound using segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:43:07.395720 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Bound port: 7734ff45-2516-4b7e-bd97-3e1c727bd6b1, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:43:07.396115 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:07.423086 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-a739a546-e68b-4aed-81e3-6e31e000ded5 service neutron] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.4408777
May 25 16:43:07.440170 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.l3_db [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Floating IP 0c27c2b0-a5a4-4301-aeed-262ea696bb1c associated. External IP: 172.27.3.243, port: 0125dd82-e845-45e1-94c0-4e9afabfecdb.
May 25 16:43:07.482430 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 4409a694-0319-4856-8e61-a5629373a62e triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:07.482801 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:07.531836 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] For port 7734ff45-2516-4b7e-bd97-3e1c727bd6b1, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:43:07.546084 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] For port 7734ff45-2516-4b7e-bd97-3e1c727bd6b1, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=7734ff45-2516-4b7e-bd97-3e1c727bd6b1,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:43:07.563448 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:07.568952 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:07.593715 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Allocated IP 172.20.0.1 (b95afcbb-a35f-4e21-a67d-e6712b2de87f/8641bb52-68d1-4215-b71c-1965a76b5e66/dfc3005c-08e6-444a-9b5b-ae177a8dc3e1) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:43:07.699935 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Routers {'eedeb3fa-21be-40a8-bc7a-e35e532db9c4'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:07.700567 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bb92340>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:07.792072 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-107a4ece-39fa-44a4-98fa-e9d5f07ffeea None None] Pushing event updated for resources: {'Port': ['ID=7734ff45-2516-4b7e-bd97-3e1c727bd6b1,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:07.797822 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-107a4ece-39fa-44a4-98fa-e9d5f07ffeea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:07.823576 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:07.840149 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Transition to ACTIVE for port object dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 will not be triggered until provisioned by entity DHCP. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:43:07.869316 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:07.873076 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-13a22f5a-72ee-4818-9a6d-ddc33991ab80 tempest-VolumesNegativeTest-1343970735 tempest-VolumesNegativeTest-1343970735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:07.914302 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Router 3ec8f109-cb75-4f41-81bd-ca78638538c9 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:43:07.923707 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] Set router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:07.938246 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Network b95afcbb-a35f-4e21-a67d-e6712b2de87f is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:43:07.939457 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:43:07.943921 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:43:07.990790 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Pushing event updated for resources: {'Port': ['ID=dfc3005c-08e6-444a-9b5b-ae177a8dc3e1,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:07.998697 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:08.020670 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-501395'] for router_interface, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:08.154235 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:43:08.164147 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-474d02b0-817c-4ca2-98c9-8b97ae575db5 None None] Sync routers for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:43:08.179414 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-474d02b0-817c-4ca2-98c9-8b97ae575db5 None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:08.180148 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-474d02b0-817c-4ca2-98c9-8b97ae575db5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b4cd850>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:08.189386 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:08.199853 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:08.272199 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 3.9686103
May 25 16:43:08.273314 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9767fed9-aaa7-4205-9878-8d298d4d5801', 'tag': '0125dd82-e845-45e1-94c0-4e9afabfecdb'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:43:08.330632 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bb92340>, [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97'}], 'enable_snat': True}, 'gw_port_id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:43:04Z', 'revision_number': 3, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port': {'id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:29:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:03Z', 'updated_at': '2021-05-25T16:43:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:08.335883 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-5ad2744d-7919-43d3-a529-b85291e4df69 None None] Provisioning for port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:43:08.343444 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4af93e4-908b-4d71-a08a-1a5dab1966bc None None] The sync data for ids ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'] in dv-cinder-786386-6-iscsi is: [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97'}], 'enable_snat': True}, 'gw_port_id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:43:04Z', 'revision_number': 3, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port': {'id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:29:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:03Z', 'updated_at': '2021-05-25T16:43:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:43:08.352187 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-5ad2744d-7919-43d3-a529-b85291e4df69 None None] Provisioning complete for port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:08.352621 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-5ad2744d-7919-43d3-a529-b85291e4df69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:08.462335 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-474d02b0-817c-4ca2-98c9-8b97ae575db5 None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:08.478154 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-5ad2744d-7919-43d3-a529-b85291e4df69 None None] Port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:43:08.558535 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9767fed9-aaa7-4205-9878-8d298d4d5801', 'tag': '0125dd82-e845-45e1-94c0-4e9afabfecdb', 'status': 'completed', 'code': 200}
May 25 16:43:08.753871 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:08.767555 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:08.800605 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-294704eb-3475-45db-ac8c-f5354edea004 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:08.859891 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device f9f25895-4aec-487b-bcc9-f61318cb3aba no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:43:08.878627 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-474d02b0-817c-4ca2-98c9-8b97ae575db5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b4cd850>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '0c27c2b0-a5a4-4301-aeed-262ea696bb1c', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.243', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': '0125dd82-e845-45e1-94c0-4e9afabfecdb', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 561, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:ba:25:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9767fed9-aaa7-4205-9878-8d298d4d5801', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:43:06Z', 'updated_at': '2021-05-25T16:43:06Z', 'revision_number': 0, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:08.882890 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-474d02b0-817c-4ca2-98c9-8b97ae575db5 None None] Checking router: 3ec8f109-cb75-4f41-81bd-ca78638538c9 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:43:08.894874 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-474d02b0-817c-4ca2-98c9-8b97ae575db5 None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:08.895639 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-474d02b0-817c-4ca2-98c9-8b97ae575db5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b4cd850>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:08.924588 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630485', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-501310'] for router_interface, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:08.932023 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Pushing event updated for resources: {'Port': ['ID=dfc3005c-08e6-444a-9b5b-ae177a8dc3e1,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:08.938788 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97d9b6fc-2cc9-481e-9599-b2fb5b4da9bd req-ce220dd0-07a4-45de-9ca5-355efa895f1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:08.940331 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-97d9b6fc-2cc9-481e-9599-b2fb5b4da9bd req-ce220dd0-07a4-45de-9ca5-355efa895f1f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 1099 time: 0.3563852
May 25 16:43:08.942271 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:08.988810 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10c4be88-e0d3-4348-aaa0-6685e9b93aff req-0ca0dad0-c00e-46cd-bdb6-28165b5ea013 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:08.997090 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-10c4be88-e0d3-4348-aaa0-6685e9b93aff req-0ca0dad0-c00e-46cd-bdb6-28165b5ea013 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.3676937
May 25 16:43:09.002640 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:09.043330 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:43:09.058155 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port f9f25895-4aec-487b-bcc9-f61318cb3aba, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:09.069390 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:09.072430 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:09.171437 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-474d02b0-817c-4ca2-98c9-8b97ae575db5 None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:09.225667 dv-cinder-786386-6-iscsi neutron-server[92014]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'code': 422} returned with failed status
May 25 16:43:09.286306 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=f9f25895-4aec-487b-bcc9-f61318cb3aba,revision_number=6']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:09.294284 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:09.296779 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:09.377522 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:43:09.386082 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:09.386918 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:09.410022 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-10c4be88-e0d3-4348-aaa0-6685e9b93aff req-db464893-1f63-4be5-8522-285bd49cea3d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.4119334
May 25 16:43:09.413363 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97d9b6fc-2cc9-481e-9599-b2fb5b4da9bd req-4c564a36-cdda-41d4-8553-d21ac538806c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:09.418205 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-97d9b6fc-2cc9-481e-9599-b2fb5b4da9bd req-4c564a36-cdda-41d4-8553-d21ac538806c service neutron] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 913 time: 0.4587677
May 25 16:43:09.573285 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:09.592070 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-97d9b6fc-2cc9-481e-9599-b2fb5b4da9bd req-09f61bbf-dbef-4017-a86f-6fc1308bf4c2 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0125dd82-e845-45e1-94c0-4e9afabfecdb HTTP/1.1" status: 200  len: 1000 time: 0.1628904
May 25 16:43:09.605441 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 7734ff45-2516-4b7e-bd97-3e1c727bd6b1, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=7734ff45-2516-4b7e-bd97-3e1c727bd6b1,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:09.613058 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:09.615304 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:09.639466 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-474d02b0-817c-4ca2-98c9-8b97ae575db5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b4cd850>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '0c27c2b0-a5a4-4301-aeed-262ea696bb1c', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.243', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': '0125dd82-e845-45e1-94c0-4e9afabfecdb', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 561, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:ba:25:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9767fed9-aaa7-4205-9878-8d298d4d5801', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:43:06Z', 'updated_at': '2021-05-25T16:43:06Z', 'revision_number': 0, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:09.644490 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-474d02b0-817c-4ca2-98c9-8b97ae575db5 None None] The sync data for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi is: [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '0c27c2b0-a5a4-4301-aeed-262ea696bb1c', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.243', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': '0125dd82-e845-45e1-94c0-4e9afabfecdb', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 561, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:ba:25:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9767fed9-aaa7-4205-9878-8d298d4d5801', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:43:06Z', 'updated_at': '2021-05-25T16:43:06Z', 'revision_number': 0, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:43:09.705877 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=7734ff45-2516-4b7e-bd97-3e1c727bd6b1,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:09.709210 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:09.710121 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Network b95afcbb-a35f-4e21-a67d-e6712b2de87f is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:43:09.711785 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97d9b6fc-2cc9-481e-9599-b2fb5b4da9bd req-7c2b8df9-335d-454b-8b41-7e04502db556 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:09.713226 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-97d9b6fc-2cc9-481e-9599-b2fb5b4da9bd req-7c2b8df9-335d-454b-8b41-7e04502db556 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.0925875
May 25 16:43:09.714208 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:43:09.915217 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-ee1825d6-8245-4682-8d8b-318c655ec648 None None] Provisioning complete for port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:09.915590 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-ee1825d6-8245-4682-8d8b-318c655ec648 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:09.969528 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97d9b6fc-2cc9-481e-9599-b2fb5b4da9bd req-76ff285f-c09c-468f-978f-7fb2e8609092 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:09.970541 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-ee1825d6-8245-4682-8d8b-318c655ec648 None None] Port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:43:09.971559 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-97d9b6fc-2cc9-481e-9599-b2fb5b4da9bd req-76ff285f-c09c-468f-978f-7fb2e8609092 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2491295
May 25 16:43:10.000847 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:43:10.160611 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44ed1ba2-0fd8-43f8-bc21-8553118f0329 None None] New status for floating IP 0c27c2b0-a5a4-4301-aeed-262ea696bb1c: ACTIVE {{(pid=92014) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:43:10.292352 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-97d9b6fc-2cc9-481e-9599-b2fb5b4da9bd req-3d3d2943-7047-4e7a-a8a3-621f0d4c902b service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3120644
May 25 16:43:10.383038 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:43:10.391805 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Sync routers for ids ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:43:10.402336 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Routers {'eedeb3fa-21be-40a8-bc7a-e35e532db9c4'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:10.411261 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346c3fee50>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:10.411477 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] 10.222.0.73 "PUT /v2.0/routers/eedeb3fa-21be-40a8-bc7a-e35e532db9c4/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.3071692
May 25 16:43:10.466819 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-97d9b6fc-2cc9-481e-9599-b2fb5b4da9bd req-611b0b00-62cd-497a-8293-867aaf7304fd service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1653180
May 25 16:43:10.629593 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Set router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:10.644998 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb136f08-7102-40e2-901d-b8fb032cee8b req-371b0a86-b434-4f2d-bd8b-555081cdd2c1 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:10.646584 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fb136f08-7102-40e2-901d-b8fb032cee8b req-371b0a86-b434-4f2d-bd8b-555081cdd2c1 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.0975306
May 25 16:43:10.693716 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fb136f08-7102-40e2-901d-b8fb032cee8b req-6e5435b3-7b05-47df-acb0-c05e13fd40b4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415881
May 25 16:43:11.003973 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346c3fee50>, [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97'}], 'enable_snat': True}, 'gw_port_id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:43:08Z', 'revision_number': 4, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port': {'id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:29:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:03Z', 'updated_at': '2021-05-25T16:43:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'dfc3005c-08e6-444a-9b5b-ae177a8dc3e1', 'name': '', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'mac_address': 'fa:16:3e:6d:34:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_interface', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:07Z', 'updated_at': '2021-05-25T16:43:08Z', 'revision_number': 2, 'project_id': '99ba5095326e4a449eb209304e90545f', 'subnets': [{'id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:11.007806 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Checking router: eedeb3fa-21be-40a8-bc7a-e35e532db9c4 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:43:11.008206 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Updating router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 binding host dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:43:11.027865 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 58982) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:11.033457 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1021459048-network', 'tenant_id': '23d514b2a6d54d9780353478bc32379c'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:43:11.038138 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:43:11.042091 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Usage tracker for resource:network and tenant:23d514b2a6d54d9780353478bc32379c is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:43:11.045223 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:43:11.052158 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:43:11.062889 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Made reservation on behalf of 23d514b2a6d54d9780353478bc32379c for: {'network': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:43:11.066029 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.067110 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.078214 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.092871 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:43:11.096712 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Usage tracker for resource:security_group_rule and tenant:23d514b2a6d54d9780353478bc32379c is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:43:11.100002 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:43:11.106716 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:43:11.195893 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.201121 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.205747 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-4ef6280c-fb08-4e43-a9fa-71b0889f2732 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:11.221825 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:11.240399 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 404}  {{(pid=92012) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:43:11.252308 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=edb6a6fb-0714-42bc-8b9c-50083ef4be6d,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:11.255991 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:11.258927 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.259278 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.segments_db [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Added segment 6f2fbde7-1734-4509-9381-f214bf3ae61a of type vlan for network c87eb745-c898-4ca2-8460-5db9ce1a5e3c
May 25 16:43:11.288396 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.307087 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:11.307725 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.324663 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.325944 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:11.326583 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.331498 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-065e2467-833e-4ce4-8baa-f484c5637247 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:11.432694 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Notify callbacks [] for port, precommit_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.440957 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 0.4083061
May 25 16:43:11.440957 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Pushing event updated for resources: {'Network': ['ID=c87eb745-c898-4ca2-8460-5db9ce1a5e3c,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:11.441280 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58986) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:11.443949 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a171e120-2221-4e25-a016-2dea5937adb9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:11.447215 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.provisioning_blocks [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Transition to ACTIVE for port object dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 will not be triggered until provisioned by entity L2. {{(pid=92015) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:43:11.447548 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Request body: {'subnet': {'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1021459048-subnet', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'ip_version': 4}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:43:11.452672 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:43:11.456194 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network c87eb745-c898-4ca2-8460-5db9ce1a5e3c details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:43:11.457043 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Usage tracker for resource:subnet and tenant:23d514b2a6d54d9780353478bc32379c is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:43:11.457454 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.460610 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:43:11.462251 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-fde22368-a2a4-40ab-8e4d-6c16bb5e69c1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:11.466993 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:43:11.479158 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Made reservation on behalf of 23d514b2a6d54d9780353478bc32379c for: {'subnet': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:43:11.482155 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-7156504'] for subnet, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.547908 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Pushing event updated for resources: {'Port': ['ID=dfc3005c-08e6-444a-9b5b-ae177a8dc3e1,revision_number=3']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:11.616325 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:11.616662 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:11.617641 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:11.617641 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:11.617641 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:11.617954 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:11.618251 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:11.618562 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:11.618877 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:11.619185 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:11.619491 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:11.619806 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92015) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:11.648855 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:11.715671 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Attempting to bind port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:43:11.716037 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Attempting to bind port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '2de50154-f13b-406e-b119-a40fe0f3910b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f'}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:43:11.716392 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Attempting to bind port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 on network b95afcbb-a35f-4e21-a67d-e6712b2de87f {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:43:11.725365 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 43, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:43:11.725940 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Checking segment: {'id': '2de50154-f13b-406e-b119-a40fe0f3910b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92015) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:43:11.726404 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.726974 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Bound using segment: {'id': '2de50154-f13b-406e-b119-a40fe0f3910b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f'} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:43:11.727646 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Bound port: dfc3005c-08e6-444a-9b5b-ae177a8dc3e1, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2de50154-f13b-406e-b119-a40fe0f3910b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f'}}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:43:11.728192 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.866851 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] For port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92015) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:43:11.881625 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] For port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=dfc3005c-08e6-444a-9b5b-ae177a8dc3e1,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92015) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:43:11.889341 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:11.894435 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:11.980715 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Routers {'eedeb3fa-21be-40a8-bc7a-e35e532db9c4'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:11.981938 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346c3fee50>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:12.051199 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Pushing event updated for resources: {'Port': ['ID=dfc3005c-08e6-444a-9b5b-ae177a8dc3e1,revision_number=4']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:12.056789 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-86a592d3-b24c-455b-9c62-7025ec38ea41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:12.145497 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6912d3b8-78c3-44a6-9d56-42b9a2d79ee0 req-45b5ed38-f5b6-4697-9607-ed0a13321a05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:12.148323 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6912d3b8-78c3-44a6-9d56-42b9a2d79ee0 req-45b5ed38-f5b6-4697-9607-ed0a13321a05 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.2794919
May 25 16:43:12.182480 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] Set router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:12.205874 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6928695', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-7156494'] for subnet, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:12.213902 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:12.245161 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6912d3b8-78c3-44a6-9d56-42b9a2d79ee0 req-f95f3077-bb9e-4de8-8e19-4733df30d0ba tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0886960
May 25 16:43:12.293234 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Pushing event updated for resources: {'Subnet': ['ID=a3775705-1932-40b1-8dfa-8ffbe812af2a,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:12.297454 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:12.302320 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Checking segment: {'id': '6f2fbde7-1734-4509-9381-f214bf3ae61a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 404, 'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:43:12.302677 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Network hostable DHCP agents. Network: c87eb745-c898-4ca2-8460-5db9ce1a5e3c, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92013) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:43:12.320557 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Network c87eb745-c898-4ca2-8460-5db9ce1a5e3c is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92013) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:43:12.329839 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, c87eb745-c898-4ca2-8460-5db9ce1a5e3c) {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:43:12.340055 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c287013-c9a3-4f43-903d-c99e1483dade None None] Network c87eb745-c898-4ca2-8460-5db9ce1a5e3c requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:43:12.342834 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:12.343617 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Notify callbacks [] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:12.371343 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 0.9288704
May 25 16:43:12.375554 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 58996) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:12.381565 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1021459048-router', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:43:12.386384 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:43:12.391083 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Usage tracker for resource:router and tenant:23d514b2a6d54d9780353478bc32379c is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:43:12.394545 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:43:12.401098 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:43:12.415086 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-506971', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2375'] for router, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:12.417365 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-504667', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-501124', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1593705', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2380'] for router, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:12.440490 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:12.575496 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346c3fee50>, [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97'}], 'enable_snat': True}, 'gw_port_id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:43:08Z', 'revision_number': 4, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port': {'id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:29:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:03Z', 'updated_at': '2021-05-25T16:43:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'dfc3005c-08e6-444a-9b5b-ae177a8dc3e1', 'name': '', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'mac_address': 'fa:16:3e:6d:34:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_interface', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:07Z', 'updated_at': '2021-05-25T16:43:11Z', 'revision_number': 4, 'project_id': '99ba5095326e4a449eb209304e90545f', 'subnets': [{'id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:12.579524 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d60576c-5158-50e8-99d6-6272b1af5e3f-c87eb745-c898-4ca2-8460-5db9ce1a5e3c', 'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'fixed_ips': [{'subnet_id': 'a3775705-1932-40b1-8dfa-8ffbe812af2a'}]}} from dv-cinder-786386-6-iscsi. {{(pid=92014) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 16:43:12.580245 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b5811ed-6d9e-4cab-bdec-e00fc94b263d None None] The sync data for ids ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'] in dv-cinder-786386-6-iscsi is: [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97'}], 'enable_snat': True}, 'gw_port_id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:43:08Z', 'revision_number': 4, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port': {'id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:29:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:03Z', 'updated_at': '2021-05-25T16:43:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'dfc3005c-08e6-444a-9b5b-ae177a8dc3e1', 'name': '', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'mac_address': 'fa:16:3e:6d:34:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_interface', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:07Z', 'updated_at': '2021-05-25T16:43:11Z', 'revision_number': 4, 'project_id': '99ba5095326e4a449eb209304e90545f', 'subnets': [{'id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:43:12.580525 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:12.797716 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.db_base_plugin_common [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Allocated IP 172.20.0.2 (c87eb745-c898-4ca2-8460-5db9ce1a5e3c/a3775705-1932-40b1-8dfa-8ffbe812af2a/0e33baae-1478-499c-8497-699ef6dec17f) {{(pid=92014) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:43:12.817162 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-501153', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-506985', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2362'] for router, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:13.089845 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Notify callbacks [] for port, precommit_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:13.105977 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Transition to ACTIVE for port object 0e33baae-1478-499c-8497-699ef6dec17f will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:43:13.136078 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Transition to ACTIVE for port object 0e33baae-1478-499c-8497-699ef6dec17f will not be triggered until provisioned by entity DHCP. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:43:13.152339 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235'] for port, after_create {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:13.158052 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:13.298618 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Network c87eb745-c898-4ca2-8460-5db9ce1a5e3c is already hosted by enough agents. {{(pid=92014) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:43:13.311172 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.scheduler.base_scheduler [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Resources bound (agent type, host, resource id):  {{(pid=92014) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:43:13.315233 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Received port after_create {{(pid=92014) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:43:13.332087 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Pushing event updated for resources: {'Port': ['ID=0e33baae-1478-499c-8497-699ef6dec17f,revision_number=1']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:13.398226 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:13.451777 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:13.597824 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Attempting to bind port 0e33baae-1478-499c-8497-699ef6dec17f on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:43:13.598297 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Attempting to bind port 0e33baae-1478-499c-8497-699ef6dec17f by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '6f2fbde7-1734-4509-9381-f214bf3ae61a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 404, 'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:43:13.599408 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Attempting to bind port 0e33baae-1478-499c-8497-699ef6dec17f on network c87eb745-c898-4ca2-8460-5db9ce1a5e3c {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:43:13.607114 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:13.617548 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 43, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:43:13.618096 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Checking segment: {'id': '6f2fbde7-1734-4509-9381-f214bf3ae61a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 404, 'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:43:13.618590 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:13.619075 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Bound using segment: {'id': '6f2fbde7-1734-4509-9381-f214bf3ae61a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 404, 'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:43:13.619645 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Bound port: 0e33baae-1478-499c-8497-699ef6dec17f, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6f2fbde7-1734-4509-9381-f214bf3ae61a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 404, 'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:43:13.620458 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:13.643671 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:43:13.671420 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:13.691980 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:13.692464 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:13.759390 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64ea6c3f-b1cb-4c16-b1eb-b6dff589cc35 req-3501f1eb-45aa-4aa8-a19d-295a5cd75cfb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:13.762404 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-64ea6c3f-b1cb-4c16-b1eb-b6dff589cc35 req-3501f1eb-45aa-4aa8-a19d-295a5cd75cfb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.2823663
May 25 16:43:13.817383 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] For port 0e33baae-1478-499c-8497-699ef6dec17f, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:43:13.821545 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] For port 0e33baae-1478-499c-8497-699ef6dec17f, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=0e33baae-1478-499c-8497-699ef6dec17f,segment=NetworkSegment(6f2fbde7-1734-4509-9381-f214bf3ae61a),segment_id=6f2fbde7-1734-4509-9381-f214bf3ae61a)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:43:13.850128 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-64ea6c3f-b1cb-4c16-b1eb-b6dff589cc35 req-804710c7-7612-42fb-a7b4-ddea6df90255 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0745413
May 25 16:43:13.876590 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:13.898473 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:13.930194 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Allocated IP 172.27.3.223 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/41dcd114-5772-4f32-89f2-074fba0becbc) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:43:13.988705 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:14.041928 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Pushing event updated for resources: {'Port': ['ID=0e33baae-1478-499c-8497-699ef6dec17f,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:14.060989 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:14.093015 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=dfc3005c-08e6-444a-9b5b-ae177a8dc3e1,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:14.102944 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:14.109472 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-107a4ece-39fa-44a4-98fa-e9d5f07ffeea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:14.154227 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:14.157633 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:14.209056 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=dfc3005c-08e6-444a-9b5b-ae177a8dc3e1,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:14.212450 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:14.213247 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:14.219356 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-a983f480-e0c5-4162-8d9e-254c75f80f36 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:14.351852 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:43:14.364736 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:43:14.367755 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:43:14.433380 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Pushing event updated for resources: {'Port': ['ID=41dcd114-5772-4f32-89f2-074fba0becbc,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:14.436202 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:14.717245 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-afc9be2d-0d96-47b4-b34d-fdbb7498821b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:14.719148 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-afc9be2d-0d96-47b4-b34d-fdbb7498821b service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511&tenant_id=a723bbfba23f463dbb8da0bdacb4b0aa HTTP/1.1" status: 200  len: 1096 time: 0.4429758
May 25 16:43:15.013717 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-f74f7139-18fd-42d1-ad2e-09a4df9fe9f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:15.015176 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-f74f7139-18fd-42d1-ad2e-09a4df9fe9f0 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a723bbfba23f463dbb8da0bdacb4b0aa&device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 1096 time: 0.2732780
May 25 16:43:15.059651 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4db2a0e5-ca09-4df4-94c4-9b61835f0643 None None] Network c87eb745-c898-4ca2-8460-5db9ce1a5e3c requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:43:15.132932 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:15.161904 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-7cd4f8c3-67da-4199-b4a5-872278de5f7e None None] Provisioning for port 0e33baae-1478-499c-8497-699ef6dec17f completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:43:15.366733 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-72dd5a2d-6909-46d1-b0a1-ad7b90515bff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:15.368478 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-72dd5a2d-6909-46d1-b0a1-ad7b90515bff service neutron] 10.222.0.76 "GET /v2.0/networks?id=3e40698a-e2cb-4812-9711-e3b481dbc8b3 HTTP/1.1" status: 200  len: 910 time: 0.3447931
May 25 16:43:15.381113 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:15.447329 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82990962-f102-4cdd-9c4c-8b853a72fd9f req-c729b1ce-ea52-43cb-b6ea-728933115e13 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:15.449491 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-82990962-f102-4cdd-9c4c-8b853a72fd9f req-c729b1ce-ea52-43cb-b6ea-728933115e13 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.4720938
May 25 16:43:15.467898 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:15.468292 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:15.608607 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-82990962-f102-4cdd-9c4c-8b853a72fd9f req-263c30cd-e694-4dc1-a89c-474d51ce909d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0976524
May 25 16:43:15.630051 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 0e33baae-1478-499c-8497-699ef6dec17f up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:15.633274 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-91662f9f-bc9f-405c-95bb-5e7a7f17466f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba HTTP/1.1" status: 200  len: 999 time: 0.2545393
May 25 16:43:15.735359 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 0e33baae-1478-499c-8497-699ef6dec17f completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:43:15.741690 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 0e33baae-1478-499c-8497-699ef6dec17f triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:15.742189 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:15.782083 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-506962', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-501218'] for router, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:15.785531 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-0a074a3a-28b3-45a8-9bd4-3dfce3501554 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:15.786945 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-0a074a3a-28b3-45a8-9bd4-3dfce3501554 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=6203ecab-ef7b-4872-ac7a-33ea4cfae323 HTTP/1.1" status: 200  len: 848 time: 0.1017363
May 25 16:43:15.876317 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:15.917252 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 0e33baae-1478-499c-8497-699ef6dec17f, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=0e33baae-1478-499c-8497-699ef6dec17f,segment=NetworkSegment(6f2fbde7-1734-4509-9381-f214bf3ae61a),segment_id=6f2fbde7-1734-4509-9381-f214bf3ae61a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:15.921695 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:15.927594 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:16.014499 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=0e33baae-1478-499c-8497-699ef6dec17f,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:16.019792 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:16.144894 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-4ac6bda5-1dc3-49e8-a56d-e444134c5ccc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:16.146376 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-4ac6bda5-1dc3-49e8-a56d-e444134c5ccc service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=3e40698a-e2cb-4812-9711-e3b481dbc8b3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2984421
May 25 16:43:16.257858 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Router 1eb7a247-2042-41e7-b3b1-d7975f120426 is scheduled to L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 with binding_index 1 {{(pid=92013) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 16:43:16.376199 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-dd52a824-a556-43d2-9abe-d57f895fc962 service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2200012
May 25 16:43:16.560582 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:43:16.569564 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Sync routers for ids ['1eb7a247-2042-41e7-b3b1-d7975f120426'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:43:16.579153 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Routers {'1eb7a247-2042-41e7-b3b1-d7975f120426'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:16.579758 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346ba5bdf0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['1eb7a247-2042-41e7-b3b1-d7975f120426'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:16.613753 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4bd6f203-2485-4169-bec8-8aa6f3845571 req-9ae61497-f917-47c7-888c-4cb9158f6d03 service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1810210
May 25 16:43:16.614894 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] Notify callbacks [] for router, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:16.615958 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-6fcf7501-9104-4808-84e7-a6e5ab45be12 admin admin] 10.222.0.73 "POST /v2.0/routers HTTP/1.1" status: 201  len: 927 time: 4.2393923
May 25 16:43:16.618723 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 59036) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:16.771414 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Set router 1eb7a247-2042-41e7-b3b1-d7975f120426 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:17.009349 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-720d7ef0-ca31-435c-88b1-dc5fd62ca13e req-8186d816-82b4-444c-b450-570411c501d9 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:17.011723 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-720d7ef0-ca31-435c-88b1-dc5fd62ca13e req-8186d816-82b4-444c-b450-570411c501d9 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.2445741
May 25 16:43:17.090409 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-720d7ef0-ca31-435c-88b1-dc5fd62ca13e req-eb7f5a29-8282-4058-a366-7172e5504b9d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0693524
May 25 16:43:17.093251 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346ba5bdf0>, [{'id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'name': 'tempest-TestMinimumBasicScenario-1021459048-router', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223'}], 'enable_snat': True}, 'gw_port_id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:12Z', 'updated_at': '2021-05-25T16:43:14Z', 'revision_number': 3, 'project_id': '23d514b2a6d54d9780353478bc32379c', 'gw_port': {'id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:2d:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'device_owner': 'network:router_gateway', 'standard_attr_id': 573, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:13Z', 'updated_at': '2021-05-25T16:43:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:17.097365 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Checking router: 1eb7a247-2042-41e7-b3b1-d7975f120426 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:43:17.097745 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Updating router 1eb7a247-2042-41e7-b3b1-d7975f120426 port 41dcd114-5772-4f32-89f2-074fba0becbc binding host dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:43:17.155343 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:17.246857 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 0e33baae-1478-499c-8497-699ef6dec17f up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:17.420992 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 0e33baae-1478-499c-8497-699ef6dec17f triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:17.421283 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:17.427627 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:17.655138 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Notify callbacks [] for port, precommit_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:17.670148 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Transition to ACTIVE for port object 41dcd114-5772-4f32-89f2-074fba0becbc will not be triggered until provisioned by entity L2. {{(pid=92014) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:43:17.677062 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:17.681719 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-9cb17a66-c770-4521-a37c-1876dccfa3ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:17.750033 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Allocated IP 172.20.0.1 (c87eb745-c898-4ca2-8460-5db9ce1a5e3c/a3775705-1932-40b1-8dfa-8ffbe812af2a/39dbdfc1-4a8f-4ab3-b86d-c5113b292e19) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:43:17.759619 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Attempting to bind port 41dcd114-5772-4f32-89f2-074fba0becbc on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:43:17.760012 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Attempting to bind port 41dcd114-5772-4f32-89f2-074fba0becbc by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:43:17.760455 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Attempting to bind port 41dcd114-5772-4f32-89f2-074fba0becbc on network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:43:17.770378 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29faa09d-3bed-431f-b2be-07fe5e08f0e9 None None] Pushing event updated for resources: {'Port': ['ID=41dcd114-5772-4f32-89f2-074fba0becbc,revision_number=2']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:17.773091 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-29faa09d-3bed-431f-b2be-07fe5e08f0e9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:17.774074 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 43, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:43:17.774445 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Checking segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92014) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:43:17.774842 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:17.775234 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Bound using segment: {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'} {{(pid=92014) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:43:17.775690 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.managers [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Bound port: 41dcd114-5772-4f32-89f2-074fba0becbc, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7eb8861e-7e01-42c3-9125-cf4be9b46f45', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb'}}] {{(pid=92014) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:43:17.776058 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:17.850339 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] For port 41dcd114-5772-4f32-89f2-074fba0becbc, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92014) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:43:17.853347 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] For port 41dcd114-5772-4f32-89f2-074fba0becbc, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=41dcd114-5772-4f32-89f2-074fba0becbc,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:43:17.858797 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:17.863253 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-107a4ece-39fa-44a4-98fa-e9d5f07ffeea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:17.901350 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:17.917465 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Transition to ACTIVE for port object 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 will not be triggered until provisioned by entity DHCP. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:43:17.938783 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Routers {'1eb7a247-2042-41e7-b3b1-d7975f120426'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:17.939820 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346ba5bdf0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['1eb7a247-2042-41e7-b3b1-d7975f120426'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:17.944899 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:17.948662 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-11232ff6-4786-49e6-ad90-8f787e22e63a tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:17.995280 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29faa09d-3bed-431f-b2be-07fe5e08f0e9 None None] Pushing event updated for resources: {'Port': ['ID=41dcd114-5772-4f32-89f2-074fba0becbc,revision_number=3']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:18.006080 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-29faa09d-3bed-431f-b2be-07fe5e08f0e9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:18.019009 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Network c87eb745-c898-4ca2-8460-5db9ce1a5e3c is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:43:18.021863 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:43:18.024481 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:43:18.062864 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Pushing event updated for resources: {'Port': ['ID=39dbdfc1-4a8f-4ab3-b86d-c5113b292e19,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:18.066280 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:18.095127 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-501395'] for router_interface, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:18.133117 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] Set router 1eb7a247-2042-41e7-b3b1-d7975f120426 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:18.293612 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:18.349834 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-9d414a84-722d-409b-b4b3-d9203c345b85 None None] Provisioning for port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:43:18.363320 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-9d414a84-722d-409b-b4b3-d9203c345b85 None None] Provisioning complete for port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:18.364181 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-9d414a84-722d-409b-b4b3-d9203c345b85 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:18.399533 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8632f62-3415-4fed-90ee-5ea2b6f70fe2 req-b8cf6853-ff0a-4e6b-9b44-9d69074e6be3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:18.401017 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c8632f62-3415-4fed-90ee-5ea2b6f70fe2 req-b8cf6853-ff0a-4e6b-9b44-9d69074e6be3 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.1552222
May 25 16:43:18.484403 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-9d414a84-722d-409b-b4b3-d9203c345b85 None None] Port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:43:18.529072 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c8632f62-3415-4fed-90ee-5ea2b6f70fe2 req-79acde4e-9e5d-4231-87a3-053fd4517f33 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1138864
May 25 16:43:18.569308 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346ba5bdf0>, [{'id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'name': 'tempest-TestMinimumBasicScenario-1021459048-router', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223'}], 'enable_snat': True}, 'gw_port_id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:12Z', 'updated_at': '2021-05-25T16:43:14Z', 'revision_number': 3, 'project_id': '23d514b2a6d54d9780353478bc32379c', 'gw_port': {'id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:2d:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'device_owner': 'network:router_gateway', 'standard_attr_id': 573, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:13Z', 'updated_at': '2021-05-25T16:43:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:18.574196 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4dfe4e2d-f64d-4904-b1d6-156566019898 None None] The sync data for ids ['1eb7a247-2042-41e7-b3b1-d7975f120426'] in dv-cinder-786386-6-iscsi is: [{'id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'name': 'tempest-TestMinimumBasicScenario-1021459048-router', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223'}], 'enable_snat': True}, 'gw_port_id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:12Z', 'updated_at': '2021-05-25T16:43:14Z', 'revision_number': 3, 'project_id': '23d514b2a6d54d9780353478bc32379c', 'gw_port': {'id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:2d:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'device_owner': 'network:router_gateway', 'standard_attr_id': 573, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:13Z', 'updated_at': '2021-05-25T16:43:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:43:18.595088 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:18.599744 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:18.629085 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ae6f5bad-000d-46e1-b15f-dc10edd7a21c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:18.711471 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Pushing event updated for resources: {'Port': ['ID=39dbdfc1-4a8f-4ab3-b86d-c5113b292e19,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:18.713884 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1630485', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-501310'] for router_interface, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:18.717457 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:18.857532 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Network c87eb745-c898-4ca2-8460-5db9ce1a5e3c is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:43:18.858673 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:43:19.054717 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Router 1eb7a247-2042-41e7-b3b1-d7975f120426 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:43:19.107878 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-a9e82b83-dbe7-4dd2-8faf-c55b44084582 None None] Provisioning complete for port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:19.108470 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-a9e82b83-dbe7-4dd2-8faf-c55b44084582 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:19.165600 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-a9e82b83-dbe7-4dd2-8faf-c55b44084582 None None] Port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:43:19.237945 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:43:19.247184 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] 10.222.0.73 "PUT /v2.0/routers/1eb7a247-2042-41e7-b3b1-d7975f120426/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6274626
May 25 16:43:20.000532 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40298e08-f21a-46c5-b015-749171c607ac req-892b1290-6dc9-4f9a-8a63-2c0d9fe9c01f tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:20.002926 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-40298e08-f21a-46c5-b015-749171c607ac req-892b1290-6dc9-4f9a-8a63-2c0d9fe9c01f tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.1755190
May 25 16:43:20.084926 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-40298e08-f21a-46c5-b015-749171c607ac req-60286f58-1830-4abf-99fa-d420fa3dd690 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0755119
May 25 16:43:21.098047 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Sync routers for ids ['1eb7a247-2042-41e7-b3b1-d7975f120426'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:43:21.122809 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Routers {'1eb7a247-2042-41e7-b3b1-d7975f120426'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:21.123706 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b8b24c0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['1eb7a247-2042-41e7-b3b1-d7975f120426'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:21.301915 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 41dcd114-5772-4f32-89f2-074fba0becbc up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:21.340075 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Set router 1eb7a247-2042-41e7-b3b1-d7975f120426 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:21.446519 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0479939c-2dab-4a1a-8ede-f15538f84388 req-0045edc9-d6f9-4fd8-a7b2-262c17e1ec31 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:21.456645 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0479939c-2dab-4a1a-8ede-f15538f84388 req-0045edc9-d6f9-4fd8-a7b2-262c17e1ec31 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.2222929
May 25 16:43:21.508081 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 41dcd114-5772-4f32-89f2-074fba0becbc completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:43:21.518423 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 41dcd114-5772-4f32-89f2-074fba0becbc triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:21.518423 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:21.567576 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0479939c-2dab-4a1a-8ede-f15538f84388 req-b1a024eb-17fd-4f85-b5a5-4b982c7c3fa6 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0905795
May 25 16:43:21.637422 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:43:21.734211 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:21.743694 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b8b24c0>, [{'id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'name': 'tempest-TestMinimumBasicScenario-1021459048-router', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223'}], 'enable_snat': True}, 'gw_port_id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:12Z', 'updated_at': '2021-05-25T16:43:18Z', 'revision_number': 4, 'project_id': '23d514b2a6d54d9780353478bc32379c', 'gw_port': {'id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:2d:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'device_owner': 'network:router_gateway', 'standard_attr_id': 573, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:13Z', 'updated_at': '2021-05-25T16:43:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '39dbdfc1-4a8f-4ab3-b86d-c5113b292e19', 'name': '', 'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'mac_address': 'fa:16:3e:c2:49:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'device_owner': 'network:router_interface', 'standard_attr_id': 574, 'fixed_ips': [{'subnet_id': 'a3775705-1932-40b1-8dfa-8ffbe812af2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:17Z', 'updated_at': '2021-05-25T16:43:18Z', 'revision_number': 2, 'project_id': '23d514b2a6d54d9780353478bc32379c', 'subnets': [{'id': 'a3775705-1932-40b1-8dfa-8ffbe812af2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:21.748797 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Checking router: 1eb7a247-2042-41e7-b3b1-d7975f120426 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:43:21.749831 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Updating router 1eb7a247-2042-41e7-b3b1-d7975f120426 port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 binding host dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 16:43:21.756087 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 41dcd114-5772-4f32-89f2-074fba0becbc, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=41dcd114-5772-4f32-89f2-074fba0becbc,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:21.766072 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:21.768511 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-26a93754-8b47-42d5-bcb5-53e5fc5313fd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:21.821301 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:21.850220 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=41dcd114-5772-4f32-89f2-074fba0becbc,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:21.864627 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:22.194460 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Notify callbacks [] for port, precommit_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:22.208950 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.provisioning_blocks [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Transition to ACTIVE for port object 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 will not be triggered until provisioned by entity L2. {{(pid=92015) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:43:22.216265 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:22.220253 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:22.454259 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Attempting to bind port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 on host dv-cinder-786386-6-iscsi for vnic_type normal with profile  {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:43:22.454632 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Attempting to bind port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 by drivers openvswitch,hyperv on host dv-cinder-786386-6-iscsi at level 0 using segments [{'id': '6f2fbde7-1734-4509-9381-f214bf3ae61a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 404, 'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c'}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:43:22.455571 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Attempting to bind port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 on network c87eb745-c898-4ca2-8460-5db9ce1a5e3c {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:43:22.461630 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Checking agent: {'id': '945b44bd-9a86-4112-bd24-c4dca76d3df9', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-786386-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 29, 34), 'started_at': datetime.datetime(2021, 5, 25, 16, 30, 4), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 43, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-786386-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:43:22.461994 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Checking segment: {'id': '6f2fbde7-1734-4509-9381-f214bf3ae61a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 404, 'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92015) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:43:22.462414 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:22.462790 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Bound using segment: {'id': '6f2fbde7-1734-4509-9381-f214bf3ae61a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 404, 'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c'} {{(pid=92015) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:43:22.463266 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.managers [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Bound port: 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19, host: dv-cinder-786386-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6f2fbde7-1734-4509-9381-f214bf3ae61a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 404, 'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c'}}] {{(pid=92015) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:43:22.463636 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:22.472615 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-468b8458-e932-42e8-9480-d3dcdbc46cdd None None] Pushing event updated for resources: {'Port': ['ID=39dbdfc1-4a8f-4ab3-b86d-c5113b292e19,revision_number=3']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:22.477137 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-468b8458-e932-42e8-9480-d3dcdbc46cdd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:22.592086 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] For port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19, host dv-cinder-786386-6-iscsi, cleared binding levels {{(pid=92015) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:43:22.595632 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.plugins.ml2.db [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] For port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19, host dv-cinder-786386-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=39dbdfc1-4a8f-4ab3-b86d-c5113b292e19,segment=NetworkSegment(6f2fbde7-1734-4509-9381-f214bf3ae61a),segment_id=6f2fbde7-1734-4509-9381-f214bf3ae61a)] {{(pid=92015) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:43:22.606153 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron_lib.callbacks.manager [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92015) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:22.619374 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-dd064559-2bc0-4ed0-a7f3-7360e97a2bb3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:22.734579 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Routers {'1eb7a247-2042-41e7-b3b1-d7975f120426'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:22.735602 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b8b24c0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['1eb7a247-2042-41e7-b3b1-d7975f120426'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:22.895335 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da75f8fd-e71e-496a-b743-0842068d72e1 req-5dd0e8ed-62da-457f-90de-c2ec9d43c628 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:22.897625 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-da75f8fd-e71e-496a-b743-0842068d72e1 req-5dd0e8ed-62da-457f-90de-c2ec9d43c628 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.1480196
May 25 16:43:22.916016 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-468b8458-e932-42e8-9480-d3dcdbc46cdd None None] Pushing event updated for resources: {'Port': ['ID=39dbdfc1-4a8f-4ab3-b86d-c5113b292e19,revision_number=4']} {{(pid=92015) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:22.927835 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG oslo_concurrency.lockutils [None req-468b8458-e932-42e8-9480-d3dcdbc46cdd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.309s {{(pid=92015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:22.966199 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-da75f8fd-e71e-496a-b743-0842068d72e1 req-2dd9f4bf-9aa1-4963-8d31-a41b630890bc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0556207
May 25 16:43:23.067389 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] Set router 1eb7a247-2042-41e7-b3b1-d7975f120426 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:23.253336 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 41dcd114-5772-4f32-89f2-074fba0becbc up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:23.329347 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 41dcd114-5772-4f32-89f2-074fba0becbc triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:23.329836 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:23.440900 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b8b24c0>, [{'id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'name': 'tempest-TestMinimumBasicScenario-1021459048-router', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223'}], 'enable_snat': True}, 'gw_port_id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:12Z', 'updated_at': '2021-05-25T16:43:18Z', 'revision_number': 4, 'project_id': '23d514b2a6d54d9780353478bc32379c', 'gw_port': {'id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:2d:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'device_owner': 'network:router_gateway', 'standard_attr_id': 573, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:13Z', 'updated_at': '2021-05-25T16:43:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '39dbdfc1-4a8f-4ab3-b86d-c5113b292e19', 'name': '', 'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'mac_address': 'fa:16:3e:c2:49:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'device_owner': 'network:router_interface', 'standard_attr_id': 574, 'fixed_ips': [{'subnet_id': 'a3775705-1932-40b1-8dfa-8ffbe812af2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:17Z', 'updated_at': '2021-05-25T16:43:22Z', 'revision_number': 4, 'project_id': '23d514b2a6d54d9780353478bc32379c', 'subnets': [{'id': 'a3775705-1932-40b1-8dfa-8ffbe812af2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:23.446443 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcb4d474-a0b1-41e0-be1f-a51b53fa91ce None None] The sync data for ids ['1eb7a247-2042-41e7-b3b1-d7975f120426'] in dv-cinder-786386-6-iscsi is: [{'id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'name': 'tempest-TestMinimumBasicScenario-1021459048-router', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223'}], 'enable_snat': True}, 'gw_port_id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:12Z', 'updated_at': '2021-05-25T16:43:18Z', 'revision_number': 4, 'project_id': '23d514b2a6d54d9780353478bc32379c', 'gw_port': {'id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:2d:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'device_owner': 'network:router_gateway', 'standard_attr_id': 573, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:13Z', 'updated_at': '2021-05-25T16:43:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '39dbdfc1-4a8f-4ab3-b86d-c5113b292e19', 'name': '', 'network_id': 'c87eb745-c898-4ca2-8460-5db9ce1a5e3c', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'mac_address': 'fa:16:3e:c2:49:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'device_owner': 'network:router_interface', 'standard_attr_id': 574, 'fixed_ips': [{'subnet_id': 'a3775705-1932-40b1-8dfa-8ffbe812af2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:17Z', 'updated_at': '2021-05-25T16:43:22Z', 'revision_number': 4, 'project_id': '23d514b2a6d54d9780353478bc32379c', 'subnets': [{'id': 'a3775705-1932-40b1-8dfa-8ffbe812af2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:43:24.310755 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc238596-1c64-4801-9577-ffe9b46a43ad req-434dc7ef-e8cc-49ab-b77b-0908e38fe1c5 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:24.318404 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cc238596-1c64-4801-9577-ffe9b46a43ad req-434dc7ef-e8cc-49ab-b77b-0908e38fe1c5 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 943 time: 0.2118342
May 25 16:43:24.394371 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cc238596-1c64-4801-9577-ffe9b46a43ad req-fd9c5832-9b2c-436b-9284-0e22f4a40b8a tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0747435
May 25 16:43:24.938419 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device f9f25895-4aec-487b-bcc9-f61318cb3aba details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:43:25.134897 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port f9f25895-4aec-487b-bcc9-f61318cb3aba, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:25.151718 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'port_id': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'mac_address': 'fa:16:3e:50:60:66', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 401, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:43:25.216679 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:25.239185 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f9f25895-4aec-487b-bcc9-f61318cb3aba {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:43:25.258142 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port f9f25895-4aec-487b-bcc9-f61318cb3aba, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:25.266296 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:25.270024 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:25.320284 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:25.415714 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=f9f25895-4aec-487b-bcc9-f61318cb3aba,revision_number=7']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:25.427490 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:25.446746 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning for port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:43:25.457392 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:25.457780 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:25.568462 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['f9f25895-4aec-487b-bcc9-f61318cb3aba'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:43:25.653711 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:25.658568 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b209483-10ab-4646-b9ea-6368d19ec93c req-e556f975-b075-4d70-873a-e0751456a834 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:25.666903 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2b209483-10ab-4646-b9ea-6368d19ec93c req-e556f975-b075-4d70-873a-e0751456a834 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 944 time: 0.1294861
May 25 16:43:25.741533 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2b209483-10ab-4646-b9ea-6368d19ec93c req-098dbf6d-3b03-4f2f-95ee-005a5e17b134 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0726461
May 25 16:43:25.743316 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] For port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=39dbdfc1-4a8f-4ab3-b86d-c5113b292e19,segment=NetworkSegment(6f2fbde7-1734-4509-9381-f214bf3ae61a),segment_id=6f2fbde7-1734-4509-9381-f214bf3ae61a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:25.761279 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:25.765033 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-450046c1-0fe9-4ac0-9035-a096be8ab679 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:25.895718 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Pushing event updated for resources: {'Port': ['ID=39dbdfc1-4a8f-4ab3-b86d-c5113b292e19,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:25.900580 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:26.963002 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d97a586-5bd2-43e5-9981-774af726b455 req-9a6229ee-26cc-4e69-b52a-5f5278242005 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:26.964579 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5d97a586-5bd2-43e5-9981-774af726b455 req-9a6229ee-26cc-4e69-b52a-5f5278242005 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 944 time: 0.0963452
May 25 16:43:26.982972 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device f9f25895-4aec-487b-bcc9-f61318cb3aba up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:27.020567 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5d97a586-5bd2-43e5-9981-774af726b455 req-2105d09c-c38b-45f1-9493-0943f998165a tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0484612
May 25 16:43:27.068062 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port f9f25895-4aec-487b-bcc9-f61318cb3aba triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:27.068567 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:27.209470 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:27.250941 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 up at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:27.338386 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:43:27.375857 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port f9f25895-4aec-487b-bcc9-f61318cb3aba, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:27.397002 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:27.400661 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:27.491683 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e9ee99e-aa07-4d89-965f-5b88a52ffc63 req-afd2684f-6f19-4e12-a5af-ab66ae7c9389 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:27.497792 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3e9ee99e-aa07-4d89-965f-5b88a52ffc63 req-afd2684f-6f19-4e12-a5af-ab66ae7c9389 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.1280513
May 25 16:43:27.509813 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'code': 200}
May 25 16:43:27.510529 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Provisioning complete for port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:27.510895 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:27.579707 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3e9ee99e-aa07-4d89-965f-5b88a52ffc63 req-ed2426b4-a49e-4534-8230-9a858c60e79b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0731995
May 25 16:43:27.624838 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=f9f25895-4aec-487b-bcc9-f61318cb3aba,revision_number=8']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:27.630159 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:27.848056 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6628c197-fd3c-4f66-9de1-b7364c483963 req-dc7d8c6f-3a6a-4ac2-9b2d-31b85ab12deb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:27.849574 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6628c197-fd3c-4f66-9de1-b7364c483963 req-dc7d8c6f-3a6a-4ac2-9b2d-31b85ab12deb service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 1098 time: 0.0951703
May 25 16:43:27.910547 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6628c197-fd3c-4f66-9de1-b7364c483963 req-06ead180-7482-426b-9290-e22e1c5c1fec service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0469306
May 25 16:43:28.296675 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4cf6c4b-5ded-4e36-90cf-e1f81d5e6617 req-ba232a08-ffd0-4212-a8a0-c3c97344620a tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:28.298133 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d4cf6c4b-5ded-4e36-90cf-e1f81d5e6617 req-ba232a08-ffd0-4212-a8a0-c3c97344620a tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.1058073
May 25 16:43:28.348820 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d4cf6c4b-5ded-4e36-90cf-e1f81d5e6617 req-b9302fd3-e5c0-406e-8635-f1ea38468d62 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0449588
May 25 16:43:28.814672 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9430de3d-b091-46d9-b090-4df554f3bc2e req-7a585407-0059-41ec-b12b-66aa3cdbbd88 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:28.816356 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9430de3d-b091-46d9-b090-4df554f3bc2e req-7a585407-0059-41ec-b12b-66aa3cdbbd88 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.1148381
May 25 16:43:28.883029 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9430de3d-b091-46d9-b090-4df554f3bc2e req-04bcecaa-b3ad-4136-9b57-bc7e381ba5d3 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0570862
May 25 16:43:29.572874 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7662a85-e216-4b20-bf71-ccbe5eb8a79f req-1106f1a7-ffae-4d42-a5c2-31e04e1a46aa tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:29.574636 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e7662a85-e216-4b20-bf71-ccbe5eb8a79f req-1106f1a7-ffae-4d42-a5c2-31e04e1a46aa tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.0989649
May 25 16:43:29.645666 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e7662a85-e216-4b20-bf71-ccbe5eb8a79f req-5773924f-37e4-4578-9913-bcb72c12aa0c tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0639830
May 25 16:43:30.116917 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3a1154-c0fa-4b2e-872c-a8bdce416149 req-fc70955d-ad34-42f1-80c4-bca9b33edc28 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:30.123989 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1c3a1154-c0fa-4b2e-872c-a8bdce416149 req-fc70955d-ad34-42f1-80c4-bca9b33edc28 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0948074
May 25 16:43:30.217503 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1c3a1154-c0fa-4b2e-872c-a8bdce416149 req-aa18db6b-ce90-4116-8067-b99f4e747daf tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0924351
May 25 16:43:30.256773 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13c16341-d205-4ad4-b8b6-55bea64a1400 req-e7ccb77c-e4f8-44d9-874d-7c2418b35650 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:30.258405 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-13c16341-d205-4ad4-b8b6-55bea64a1400 req-e7ccb77c-e4f8-44d9-874d-7c2418b35650 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 946 time: 0.1312129
May 25 16:43:30.306161 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-13c16341-d205-4ad4-b8b6-55bea64a1400 req-63fd8437-d7e4-41d7-88b4-1ba2f93a7746 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=680c886d-79ec-4bd5-9d15-51f1b36f6780&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418322
May 25 16:43:31.102539 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-419b44be-5107-494e-a6b8-68ce098ffd9a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:31.103885 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-419b44be-5107-494e-a6b8-68ce098ffd9a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/networks?id=b95afcbb-a35f-4e21-a67d-e6712b2de87f HTTP/1.1" status: 200  len: 815 time: 0.1472876
May 25 16:43:31.126092 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-6323a508-4724-4b4c-a3d2-f3e4c059b0a9 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/quotas/99ba5095326e4a449eb209304e90545f HTTP/1.1" status: 200  len: 375 time: 0.0104108
May 25 16:43:31.212546 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-8409a59d-80e7-4072-ad75-6ac6299b0055 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Synchronizing usage tracker for tenant:99ba5095326e4a449eb209304e90545f on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:43:31.229438 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-8409a59d-80e7-4072-ad75-6ac6299b0055 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Unset dirty status for tenant:99ba5095326e4a449eb209304e90545f on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:43:31.230739 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-8409a59d-80e7-4072-ad75-6ac6299b0055 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=99ba5095326e4a449eb209304e90545f&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0986865
May 25 16:43:31.418872 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-75ee80c6-ebd6-4a5d-a9f4-d4d785449a08 service neutron] 10.222.0.73 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1759100
May 25 16:43:31.420361 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d8b84f49-258d-46bd-a103-9b12a54cc48f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:31.599916 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c99259c8-14c8-4d76-b639-70e59a4ca2b1 req-afc35933-be70-4859-9c9c-57696922cac2 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:31.601360 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c99259c8-14c8-4d76-b639-70e59a4ca2b1 req-afc35933-be70-4859-9c9c-57696922cac2 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.2690315
May 25 16:43:31.671166 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d14248e8-bd61-43e2-9cc6-64712ef01b91 service neutron] 10.222.0.73 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2439740
May 25 16:43:31.676247 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c99259c8-14c8-4d76-b639-70e59a4ca2b1 req-a7005d7a-56cc-46bf-b298-82e267ddbbc3 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0679991
May 25 16:43:31.875281 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c97248b9-5b1a-4ec6-9924-39667cda7c8a req-32a9c883-c3ff-47df-9e61-adfeee262e91 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 210 time: 0.0577700
May 25 16:43:31.907572 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99539008-e1dc-4e86-bc0c-e723a2ab8fe2 req-525f99f8-b00d-4191-88fb-6714462b9fa0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:31.909677 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-99539008-e1dc-4e86-bc0c-e723a2ab8fe2 req-525f99f8-b00d-4191-88fb-6714462b9fa0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 946 time: 0.1351068
May 25 16:43:31.960230 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-99539008-e1dc-4e86-bc0c-e723a2ab8fe2 req-81a2af27-4d6d-4004-9d0b-0f5495757400 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=680c886d-79ec-4bd5-9d15-51f1b36f6780&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0443029
May 25 16:43:32.355560 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-811515ea-81da-4e78-8124-fa67761e5571 req-3dc37776-4691-421f-a80f-611e439669ca tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:32.356988 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-811515ea-81da-4e78-8124-fa67761e5571 req-3dc37776-4691-421f-a80f-611e439669ca tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.76 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 946 time: 0.0842454
May 25 16:43:32.496124 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Deleting port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:43:32.496460 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:32.629856 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] For port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:32.630128 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:33.117209 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8b13cbef-95cd-4da2-a185-3a08a194db16 req-dc574999-5172-4efa-ab08-4993ee3edc02 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 210 time: 0.0743477
May 25 16:43:33.132835 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:33.133213 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:33.133565 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.l3_db [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Floating IP b2dc0c55-8abb-41f2-815a-17cf5300c6f0 disassociated. External IP: 172.27.3.144, port: 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473.
May 25 16:43:33.133901 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Calling delete_port for 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:43:33.167252 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f44a2173-eb34-4acc-8d14-faca0a4d525a req-60b6d0a9-0c66-48c3-ae12-8db94c62dd86 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:33.168708 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f44a2173-eb34-4acc-8d14-faca0a4d525a req-60b6d0a9-0c66-48c3-ae12-8db94c62dd86 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.3741372
May 25 16:43:33.235235 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-b2d1f117-ff45-4b00-be42-98f1414f7966 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:33.237237 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-b2d1f117-ff45-4b00-be42-98f1414f7966 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.76 "GET /v2.0/networks?id=b95afcbb-a35f-4e21-a67d-e6712b2de87f HTTP/1.1" status: 200  len: 815 time: 0.3011794
May 25 16:43:33.290480 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Request body: {'port': {'device_id': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'admin_state_up': True, 'tenant_id': '99ba5095326e4a449eb209304e90545f'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:43:33.325828 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f44a2173-eb34-4acc-8d14-faca0a4d525a req-fba3832c-6f1b-41ad-8a3c-e9c531720659 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.1492345
May 25 16:43:33.543861 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:43:33.567361 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d953e480-4e99-4b14-838f-9c484ab42ab4 req-c06da393-a2ef-402d-bc37-dafd82b1e150 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:33.575124 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d953e480-4e99-4b14-838f-9c484ab42ab4 req-c06da393-a2ef-402d-bc37-dafd82b1e150 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 946 time: 0.3301704
May 25 16:43:33.577942 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:43:33.702168 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:33.710678 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-de71cf06-16c8-49cf-9b7d-05b50537c78c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:33.756855 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Made reservation on behalf of 99ba5095326e4a449eb209304e90545f for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:43:33.760332 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:33.780865 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event deleted for resources: {'Port': ['ID=7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:33.790442 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:33.818180 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d953e480-4e99-4b14-838f-9c484ab42ab4 req-7ab0fdca-1cb9-4af1-b18a-f42764506880 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups?id=680c886d-79ec-4bd5-9d15-51f1b36f6780&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2399642
May 25 16:43:33.852369 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:34.108400 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7267a2c7-dbf9-428e-ad78-bf5dc8c497dc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:34.143244 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Router d0ffdac8-c8d7-4bac-8f41-858898f1783d has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:43:34.149437 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Allocated IP 172.20.0.8 (b95afcbb-a35f-4e21-a67d-e6712b2de87f/8641bb52-68d1-4215-b71c-1965a76b5e66/0266b6be-df05-4348-ad78-3c6b9cb56031) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:43:34.336909 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-654b68f9-daac-4543-a7e5-515e029926bc req-f4f03ada-03d3-446b-ad28-3d7806b2f74b tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 210 time: 0.0870209
May 25 16:43:34.598307 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:43:34.607977 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d5bcf7c-2981-40ae-b538-2201c86584e5 None None] Sync routers for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:43:34.619991 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d5bcf7c-2981-40ae-b538-2201c86584e5 None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:34.620833 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-5d5bcf7c-2981-40ae-b538-2201c86584e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bbeaa60>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:34.720909 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] No DVR routers for this DVR port 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:43:34.724048 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:34.730719 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5', 'name': 'network-vif-deleted', 'tag': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:43:34.761150 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:34.796541 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-561d2641-6199-4724-a655-c35827a0ed06 req-7ba45d14-3f98-43dc-877e-cbe2e6007e8d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:34.798167 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-561d2641-6199-4724-a655-c35827a0ed06 req-7ba45d14-3f98-43dc-877e-cbe2e6007e8d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.3454962
May 25 16:43:34.799431 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-811515ea-81da-4e78-8124-fa67761e5571 req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.76 "DELETE /v2.0/ports/7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 HTTP/1.1" status: 204  len: 173 time: 2.4363480
May 25 16:43:34.801169 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Transition to ACTIVE for port object 0266b6be-df05-4348-ad78-3c6b9cb56031 will not be triggered until provisioned by entity DHCP. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:43:34.808379 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5', 'name': 'network-vif-deleted', 'tag': '7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473', 'status': 'completed', 'code': 200}
May 25 16:43:34.842982 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-5d5bcf7c-2981-40ae-b538-2201c86584e5 None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:34.867873 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-561d2641-6199-4724-a655-c35827a0ed06 req-50055f24-cd46-47dc-a415-b5f5cd78a86b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0633814
May 25 16:43:34.909947 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:34.917554 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-30a11f38-c7c8-4a41-9622-62d7620dc209 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:35.044580 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Network b95afcbb-a35f-4e21-a67d-e6712b2de87f is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:43:35.054245 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:43:35.064342 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:43:35.100541 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:35.117314 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-b0c55860-a51c-4a79-be51-28b41a07f2cb req-4fdf536e-41c6-4ecc-a574-516baf123096 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Synchronizing usage tracker for tenant:63f896ab0d7e44158204551033c33ba4 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:43:35.145438 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event updated for resources: {'Port': ['ID=0266b6be-df05-4348-ad78-3c6b9cb56031,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:35.152214 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:35.171306 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:35.179141 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:35.229973 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-b0c55860-a51c-4a79-be51-28b41a07f2cb req-4fdf536e-41c6-4ecc-a574-516baf123096 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Unset dirty status for tenant:63f896ab0d7e44158204551033c33ba4 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:43:35.238909 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b0c55860-a51c-4a79-be51-28b41a07f2cb req-4fdf536e-41c6-4ecc-a574-516baf123096 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 210 time: 0.2628129
May 25 16:43:35.243673 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.9608283
May 25 16:43:35.246666 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-5d5bcf7c-2981-40ae-b538-2201c86584e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bbeaa60>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:41Z', 'revision_number': 5, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:35.253710 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d5bcf7c-2981-40ae-b538-2201c86584e5 None None] Checking router: d0ffdac8-c8d7-4bac-8f41-858898f1783d for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:43:35.269967 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d5bcf7c-2981-40ae-b538-2201c86584e5 None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:35.270596 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-5d5bcf7c-2981-40ae-b538-2201c86584e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346bbeaa60>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:35.465308 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-7e5f5e9d-eb7c-4867-a840-b820003d110e None None] Provisioning for port 0266b6be-df05-4348-ad78-3c6b9cb56031 completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:43:35.475052 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-7e5f5e9d-eb7c-4867-a840-b820003d110e None None] Provisioning complete for port 0266b6be-df05-4348-ad78-3c6b9cb56031 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:35.475410 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7e5f5e9d-eb7c-4867-a840-b820003d110e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:35.539462 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-5d5bcf7c-2981-40ae-b538-2201c86584e5 None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:35.542221 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b748e0a0-195e-4493-bb63-1d21e98db7dd req-1f9386a0-a927-437f-bf6e-041bd20ccf98 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:35.543095 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-b748e0a0-195e-4493-bb63-1d21e98db7dd req-1f9386a0-a927-437f-bf6e-041bd20ccf98 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Synchronizing usage tracker for tenant:99ba5095326e4a449eb209304e90545f on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:43:35.565462 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-b748e0a0-195e-4493-bb63-1d21e98db7dd req-1f9386a0-a927-437f-bf6e-041bd20ccf98 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Unset dirty status for tenant:99ba5095326e4a449eb209304e90545f on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:43:35.566842 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b748e0a0-195e-4493-bb63-1d21e98db7dd req-1f9386a0-a927-437f-bf6e-041bd20ccf98 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 931 time: 0.1095202
May 25 16:43:35.592336 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-7e5f5e9d-eb7c-4867-a840-b820003d110e None None] Port 0266b6be-df05-4348-ad78-3c6b9cb56031 cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:43:35.642739 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b748e0a0-195e-4493-bb63-1d21e98db7dd req-999bff70-417b-4ea6-b154-046ee51ed4d9 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0689597
May 25 16:43:35.887744 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-5d5bcf7c-2981-40ae-b538-2201c86584e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346bbeaa60>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:41Z', 'revision_number': 5, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:35.892892 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d5bcf7c-2981-40ae-b538-2201c86584e5 None None] The sync data for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi is: [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:37:28Z', 'revision_number': 4, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'f4b0710d-b203-43ad-9bf9-b9df5851c043', 'name': '', 'network_id': 'ce683266-622a-4b13-a610-301441bf2882', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'mac_address': 'fa:16:3e:51:01:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:26Z', 'updated_at': '2021-05-25T16:37:41Z', 'revision_number': 5, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'subnets': [{'id': '06161ba6-62a3-443f-9cfb-bccf3f60ad9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:43:36.080594 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7a77cd0-9473-4743-aeef-4527476a3ce8 req-8994aefb-697f-485c-9621-08f7ccc1c680 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:36.082202 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c7a77cd0-9473-4743-aeef-4527476a3ce8 req-8994aefb-697f-485c-9621-08f7ccc1c680 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0844977
May 25 16:43:36.134374 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c7a77cd0-9473-4743-aeef-4527476a3ce8 req-88edd8b0-7975-417f-a0b0-bb4c3a432261 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0439503
May 25 16:43:36.175846 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fa131c5-89f8-41e5-b113-5f0754b253ed None None] New status for floating IP b2dc0c55-8abb-41f2-815a-17cf5300c6f0: DOWN {{(pid=92015) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:43:36.408570 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-42142844-bf2c-4e29-9202-9bd35539025b req-d8b57599-25cb-40e2-8786-6f339852cbe8 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 210 time: 0.0513849
May 25 16:43:36.572207 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:36.929811 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37d6779-335d-4ae9-96da-ca84fb06e9a9 req-95e58239-1264-4d73-b0c1-1aaa6f25ee54 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:36.931211 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c37d6779-335d-4ae9-96da-ca84fb06e9a9 req-95e58239-1264-4d73-b0c1-1aaa6f25ee54 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 931 time: 0.1756270
May 25 16:43:36.979450 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c37d6779-335d-4ae9-96da-ca84fb06e9a9 req-91a9e890-8647-410e-939f-bcd059c7c15c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421636
May 25 16:43:37.033439 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:43:37.068517 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:43:37.068860 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 7c53b01f-00a5-4ae2-ae76-1f3e9cb8f473 not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:43:37.340079 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57dbbdb1-9879-4fb7-acbe-10aa21d27ae7 req-8c14c4f0-433a-4796-8f48-3dc3080e6157 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:37.341626 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-57dbbdb1-9879-4fb7-acbe-10aa21d27ae7 req-8c14c4f0-433a-4796-8f48-3dc3080e6157 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0911224
May 25 16:43:37.389870 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-57dbbdb1-9879-4fb7-acbe-10aa21d27ae7 req-c37f731e-a1a8-4c5e-bbb2-c23dfa1e01ec tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0414841
May 25 16:43:37.566578 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f234fb1a-51e9-44af-8a71-daa875e23979 req-18ce91fe-6821-4fba-a8bb-88f6979f0894 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 210 time: 0.0478258
May 25 16:43:38.172901 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-448b7551-da06-49cb-ae4c-37d1d54b60e5 req-0f65f3c5-9506-47cb-a5ce-ea63ca2623de tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:38.174508 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-448b7551-da06-49cb-ae4c-37d1d54b60e5 req-0f65f3c5-9506-47cb-a5ce-ea63ca2623de tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 931 time: 0.0812933
May 25 16:43:38.225624 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-448b7551-da06-49cb-ae4c-37d1d54b60e5 req-fcdfa7fa-67b6-42c5-a724-7890bf0a4855 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442786
May 25 16:43:38.588465 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5afb971-6926-4870-bf1d-c112fe94eb85 req-5cc0967f-7608-429f-816e-3d0929a4e97b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:38.590002 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d5afb971-6926-4870-bf1d-c112fe94eb85 req-5cc0967f-7608-429f-816e-3d0929a4e97b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0854206
May 25 16:43:38.647345 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d5afb971-6926-4870-bf1d-c112fe94eb85 req-7c929def-42ec-4112-bc7a-54b9e73d9393 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0489638
May 25 16:43:38.763995 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9cc5f056-1600-43c1-b447-8a31473912cd req-907eac9f-4344-4c1c-9ce9-4dc0a9c1ddfe tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 210 time: 0.0782187
May 25 16:43:39.421386 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163daf4b-6a10-40ed-9ec3-39d994208818 req-b226eadc-9f91-4dd6-889e-d2d7d6d0b2c8 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:39.422929 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-163daf4b-6a10-40ed-9ec3-39d994208818 req-b226eadc-9f91-4dd6-889e-d2d7d6d0b2c8 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 931 time: 0.0835807
May 25 16:43:39.469824 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-163daf4b-6a10-40ed-9ec3-39d994208818 req-4f0d4eab-c3c6-4269-bb89-7b6679f5f8da tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408356
May 25 16:43:39.864775 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bcf6a72-d26b-4dae-bff9-9422912f0b2c req-2f98dfca-672e-42be-b7c3-ee5756436c6b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:39.867168 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2bcf6a72-d26b-4dae-bff9-9422912f0b2c req-2f98dfca-672e-42be-b7c3-ee5756436c6b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0906806
May 25 16:43:39.944986 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-117352e0-2787-4e09-8f4f-4f5ae77387a6 req-8fe3c31a-4d0b-4290-a963-1d1d9310a59f tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 210 time: 0.0571158
May 25 16:43:39.957882 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2bcf6a72-d26b-4dae-bff9-9422912f0b2c req-a6ca277d-3914-4b23-aa2a-9465cf5cb2b3 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0847847
May 25 16:43:40.671829 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd7bc24-1f10-48e8-8558-928ab3169733 req-4fe96c71-d45c-44bb-a03b-38bc3fce967e tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:40.673465 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0cd7bc24-1f10-48e8-8558-928ab3169733 req-4fe96c71-d45c-44bb-a03b-38bc3fce967e tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 931 time: 0.0905964
May 25 16:43:40.722506 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0cd7bc24-1f10-48e8-8558-928ab3169733 req-d533e9ae-8e31-4255-b28f-83f813bca067 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433121
May 25 16:43:41.157066 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a2ce51ec-9f1d-4508-8bb4-e87578971ef4 req-8a255a20-b2b1-46c0-b275-abcc882161bb tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 210 time: 0.0793896
May 25 16:43:41.208277 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab870e2b-f94d-4c07-bca6-7ecfa51b855f req-5c7b2ee4-f32c-4783-9d8f-2f7688a25047 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:41.209778 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ab870e2b-f94d-4c07-bca6-7ecfa51b855f req-5c7b2ee4-f32c-4783-9d8f-2f7688a25047 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0985994
May 25 16:43:41.256940 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ab870e2b-f94d-4c07-bca6-7ecfa51b855f req-ceabae27-9a21-4468-ba5f-1070e35ab65e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0412204
May 25 16:43:41.919651 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f8241ea-1c29-486a-9559-28bcd597e19c req-c0b56e04-09c5-4c58-9ae2-12165ef7e8af tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:41.921099 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7f8241ea-1c29-486a-9559-28bcd597e19c req-c0b56e04-09c5-4c58-9ae2-12165ef7e8af tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 931 time: 0.0828297
May 25 16:43:41.966186 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7f8241ea-1c29-486a-9559-28bcd597e19c req-ac96b1d8-d18c-4937-8fdd-6ba601259237 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387068
May 25 16:43:42.315454 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-97eb1ae6-7eea-4546-bcf1-fc824433a691 req-1f721a97-cf93-4641-aeec-2089ebc6a28d tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 210 time: 0.0502143
May 25 16:43:42.466162 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c383b79-f8e4-4cf5-97c2-53316b74d4e3 req-d13dc4f9-0839-4ab8-8601-4a7b3b810c0b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:42.467598 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9c383b79-f8e4-4cf5-97c2-53316b74d4e3 req-d13dc4f9-0839-4ab8-8601-4a7b3b810c0b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0855625
May 25 16:43:42.514121 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9c383b79-f8e4-4cf5-97c2-53316b74d4e3 req-f7d8e09a-b9c5-42f8-b087-f46f8b20c65b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0408790
May 25 16:43:43.181651 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92bb611a-bc04-418d-8726-0f2bb795d545 req-597c8a84-78e0-43f4-ae3b-f36bff784ef7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:43.183590 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92bb611a-bc04-418d-8726-0f2bb795d545 req-597c8a84-78e0-43f4-ae3b-f36bff784ef7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 931 time: 0.0873806
May 25 16:43:43.229569 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92bb611a-bc04-418d-8726-0f2bb795d545 req-c2d3f25f-95ca-472b-8dea-3f029fc9848f tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396657
May 25 16:43:43.477745 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2e8505f4-08b0-418d-8542-4ddb10d8a51c req-efeb4681-8232-48c2-9a61-3247d3d36ce0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 210 time: 0.0446324
May 25 16:43:43.741203 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f34c42f5-2220-4687-9687-7ecdbf24147c req-46d755bd-1a95-4d00-9151-33fae53fe6df tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:43.742779 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f34c42f5-2220-4687-9687-7ecdbf24147c req-46d755bd-1a95-4d00-9151-33fae53fe6df tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0941079
May 25 16:43:43.786988 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f34c42f5-2220-4687-9687-7ecdbf24147c req-081b98c8-abec-4f9e-92a3-f2abea17f6c2 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0385556
May 25 16:43:44.104875 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:44.417988 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4f1a48a-3d5a-4e98-9fca-45fe83daacaf req-46ab1fe3-3c98-42d7-aa9f-0fda1953f3f7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:44.419414 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e4f1a48a-3d5a-4e98-9fca-45fe83daacaf req-46ab1fe3-3c98-42d7-aa9f-0fda1953f3f7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 931 time: 0.0818999
May 25 16:43:44.465805 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e4f1a48a-3d5a-4e98-9fca-45fe83daacaf req-bdfb4554-eed3-4d39-9027-f6e9cb91e619 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401509
May 25 16:43:44.628189 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8a795cd0-0508-48de-9e6a-e937becce0dd req-aa73160c-9e63-4a4f-b394-68176962ccbd tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 210 time: 0.0457582
May 25 16:43:44.994766 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ebdfaf4-ba46-4a75-9c39-fa3025fd2503 req-8023b315-db9e-4c57-804b-871ab2cf2f61 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:44.996133 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5ebdfaf4-ba46-4a75-9c39-fa3025fd2503 req-8023b315-db9e-4c57-804b-871ab2cf2f61 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0806279
May 25 16:43:45.040522 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5ebdfaf4-ba46-4a75-9c39-fa3025fd2503 req-6a11c122-afe8-4a1a-9a37-776dbb2a38c8 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0382235
May 25 16:43:45.273926 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Request body: {'port': {'device_id': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:43:45.474208 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:45.843914 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb56901e-efc5-45c0-aced-195f8ae39f51 req-8b1e93e5-f1e0-4de8-8464-da2dc8f3442e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:45.845892 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eb56901e-efc5-45c0-aced-195f8ae39f51 req-8b1e93e5-f1e0-4de8-8464-da2dc8f3442e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9c4a08443867402386f8ec58d2615739&device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 1098 time: 0.3280134
May 25 16:43:45.861759 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-feaeeeda-aa82-49d3-9388-1522f4145638 req-5590307a-0770-4eac-954a-618068fcb064 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/ports?device_id=9dcb4d57-d36b-4f50-8f4e-336fe1fb4cf5 HTTP/1.1" status: 200  len: 210 time: 0.1068785
May 25 16:43:45.883443 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a70258-3abb-457f-b0b9-59d959a83e6c req-925e2235-d01d-4da7-a689-b231b008d5fb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:45.883443 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-04a70258-3abb-457f-b0b9-59d959a83e6c req-925e2235-d01d-4da7-a689-b231b008d5fb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 931 time: 0.3018343
May 25 16:43:46.062235 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-04a70258-3abb-457f-b0b9-59d959a83e6c req-35160ab6-c6e0-454f-9f5e-ecdf6962b07d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1457245
May 25 16:43:46.140995 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb56901e-efc5-45c0-aced-195f8ae39f51 req-4e76fcde-c8c6-4e7a-ab08-bdbe69c03cae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:46.143029 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eb56901e-efc5-45c0-aced-195f8ae39f51 req-4e76fcde-c8c6-4e7a-ab08-bdbe69c03cae service neutron] 10.222.0.76 "GET /v2.0/networks?id=b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 200  len: 918 time: 0.2592380
May 25 16:43:46.210091 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0266b6be-df05-4348-ad78-3c6b9cb56031 {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:43:46.238145 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:46.264519 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Transition to ACTIVE for port object 0266b6be-df05-4348-ad78-3c6b9cb56031 will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:43:46.272511 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:46.279799 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:46.315520 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eb56901e-efc5-45c0-aced-195f8ae39f51 req-d93a689f-70c0-4621-95c4-ee725284ae5f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5c47c017-af78-4c20-a79c-f54715856946 HTTP/1.1" status: 200  len: 1000 time: 0.1628501
May 25 16:43:46.496385 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Pushing event updated for resources: {'Port': ['ID=0266b6be-df05-4348-ad78-3c6b9cb56031,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:46.534830 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:46.586824 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb56901e-efc5-45c0-aced-195f8ae39f51 req-64b20934-bb5a-47fc-b971-c9f191273482 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:46.588240 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eb56901e-efc5-45c0-aced-195f8ae39f51 req-64b20934-bb5a-47fc-b971-c9f191273482 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=950695d6-8663-4ed4-92fd-b43d8ea5a820 HTTP/1.1" status: 200  len: 856 time: 0.2537875
May 25 16:43:46.687914 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333d38d0-8995-42dd-8e9f-53217513af8b req-78ae89e2-b4f5-41fe-8d94-8ab93eb07eb6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:46.689867 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-333d38d0-8995-42dd-8e9f-53217513af8b req-78ae89e2-b4f5-41fe-8d94-8ab93eb07eb6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.3652949
May 25 16:43:46.690480 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Attempting to bind port 0266b6be-df05-4348-ad78-3c6b9cb56031 on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:43:46.690801 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Attempting to bind port 0266b6be-df05-4348-ad78-3c6b9cb56031 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '2de50154-f13b-406e-b119-a40fe0f3910b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:43:46.691132 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Attempting to bind port 0266b6be-df05-4348-ad78-3c6b9cb56031 on network b95afcbb-a35f-4e21-a67d-e6712b2de87f {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:43:46.712437 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Port 0266b6be-df05-4348-ad78-3c6b9cb56031 on network b95afcbb-a35f-4e21-a67d-e6712b2de87f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:43:46.712751 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Attempting to bind port 0266b6be-df05-4348-ad78-3c6b9cb56031 on network b95afcbb-a35f-4e21-a67d-e6712b2de87f {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:43:46.727524 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 43, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:43:46.727833 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Checking segment: {'id': '2de50154-f13b-406e-b119-a40fe0f3910b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:43:46.728210 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Bound using segment: {'id': '2de50154-f13b-406e-b119-a40fe0f3910b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:43:46.728626 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Bound port: 0266b6be-df05-4348-ad78-3c6b9cb56031, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2de50154-f13b-406e-b119-a40fe0f3910b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 432, 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:43:46.728963 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:46.765058 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-333d38d0-8995-42dd-8e9f-53217513af8b req-0bfd9e67-3307-4533-af19-2d5dc9394b1c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0682571
May 25 16:43:46.824225 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb56901e-efc5-45c0-aced-195f8ae39f51 req-636a7223-4015-4549-8e94-2179672d54ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:46.825675 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eb56901e-efc5-45c0-aced-195f8ae39f51 req-636a7223-4015-4549-8e94-2179672d54ec service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b8cabc9a-0f6f-485c-8020-441b42ac019b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2230792
May 25 16:43:46.936600 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] For port 0266b6be-df05-4348-ad78-3c6b9cb56031, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:43:46.949927 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] For port 0266b6be-df05-4348-ad78-3c6b9cb56031, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0266b6be-df05-4348-ad78-3c6b9cb56031,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:43:46.966815 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:46.973514 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-e08af28c-8f7a-4f5b-9b04-fe69587ab548 tempest-DeleteServersTestJSON-1964521131 tempest-DeleteServersTestJSON-1964521131-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:46.984388 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59346) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:47.056910 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-36433aea-96e0-40ae-886a-bb97af265fb6 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:47.085725 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-36433aea-96e0-40ae-886a-bb97af265fb6 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:47.139792 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:47.140466 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:47.142373 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] 10.222.0.76 "PUT /v2.0/ports/0266b6be-df05-4348-ad78-3c6b9cb56031 HTTP/1.1" status: 200  len: 1093 time: 1.8726530
May 25 16:43:47.142955 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:43:47.145216 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-36433aea-96e0-40ae-886a-bb97af265fb6 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:47.156174 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eb56901e-efc5-45c0-aced-195f8ae39f51 req-d694a395-ce83-4eef-bc77-3472e4e434f0 service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3116210
May 25 16:43:47.158501 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f9aaeea8-cf4a-4932-a35c-2f54811916a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:47.167399 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Pushing event updated for resources: {'Port': ['ID=0266b6be-df05-4348-ad78-3c6b9cb56031,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:47.174112 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36433aea-96e0-40ae-886a-bb97af265fb6 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=680c886d-79ec-4bd5-9d15-51f1b36f6780,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:47.190209 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:47.191102 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-36433aea-96e0-40ae-886a-bb97af265fb6 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:47.198314 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-36433aea-96e0-40ae-886a-bb97af265fb6 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:47.199642 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-36433aea-96e0-40ae-886a-bb97af265fb6 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "DELETE /v2.0/security-groups/680c886d-79ec-4bd5-9d15-51f1b36f6780 HTTP/1.1" status: 204  len: 168 time: 0.2141671
May 25 16:43:47.202444 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59354) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:47.239843 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.api.v2.resource [None req-6f55a139-b9e6-422b-8106-b1d054816df9 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] show failed (client error): The resource could not be found.
May 25 16:43:47.241436 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-6f55a139-b9e6-422b-8106-b1d054816df9 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "GET /v2.0/security-groups/680c886d-79ec-4bd5-9d15-51f1b36f6780 HTTP/1.1" status: 404  len: 347 time: 0.0371635
May 25 16:43:47.244115 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59358) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:47.266298 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031', 'status': 'completed', 'code': 200}
May 25 16:43:47.448712 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eb56901e-efc5-45c0-aced-195f8ae39f51 req-ae2c0ac1-7b2d-4771-8a87-844c71185246 service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2827103
May 25 16:43:47.462607 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-3d6c2117-3011-468a-bfd2-9b4e6665074e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:47.463963 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-3d6c2117-3011-468a-bfd2-9b4e6665074e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=99ba5095326e4a449eb209304e90545f&device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 1096 time: 0.1963205
May 25 16:43:47.472950 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55f2c3bb-3016-437d-961b-9b7091d9afb9 req-9cf55e1a-a3b0-46e8-a5a3-2f05fba466b3 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:47.474393 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55f2c3bb-3016-437d-961b-9b7091d9afb9 req-9cf55e1a-a3b0-46e8-a5a3-2f05fba466b3 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 943 time: 0.2106657
May 25 16:43:47.480124 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-912c9af4-2dc8-496f-8f83-d840b2e534aa tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Deleting port 4e12d041-6f9a-4342-84ea-f3d2d019dde4 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:43:47.480466 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-912c9af4-2dc8-496f-8f83-d840b2e534aa tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:47.563098 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-dc5a7059-3873-4b86-b2eb-1445b56a0555 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0266b6be-df05-4348-ad78-3c6b9cb56031 HTTP/1.1" status: 200  len: 217 time: 0.0685585
May 25 16:43:47.585540 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55f2c3bb-3016-437d-961b-9b7091d9afb9 req-82f76649-805f-4cfa-97b1-375c73bd5218 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1045363
May 25 16:43:47.646042 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-51f72451-ddbc-4019-8e19-f6e2676a8933 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:47.647490 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-51f72451-ddbc-4019-8e19-f6e2676a8933 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=8641bb52-68d1-4215-b71c-1965a76b5e66 HTTP/1.1" status: 200  len: 854 time: 0.0654013
May 25 16:43:47.725331 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-912c9af4-2dc8-496f-8f83-d840b2e534aa tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:47.725898 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-912c9af4-2dc8-496f-8f83-d840b2e534aa tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:47.728475 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-066277c5-8f1f-4401-a673-1635254dc146 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:47.730079 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-066277c5-8f1f-4401-a673-1635254dc146 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b95afcbb-a35f-4e21-a67d-e6712b2de87f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0715134
May 25 16:43:47.855447 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-912c9af4-2dc8-496f-8f83-d840b2e534aa tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Calling delete_port for 4e12d041-6f9a-4342-84ea-f3d2d019dde4 owned by network:floatingip {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:43:47.871851 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-0b74bf36-09a7-4272-891a-14e49161f9ce service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1264613
May 25 16:43:47.966752 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-912c9af4-2dc8-496f-8f83-d840b2e534aa tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:47.971619 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-eb250057-8a22-4433-9c18-de3a23f6eafc tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:48.015092 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-912c9af4-2dc8-496f-8f83-d840b2e534aa tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Pushing event deleted for resources: {'Port': ['ID=4e12d041-6f9a-4342-84ea-f3d2d019dde4,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:48.019098 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-912c9af4-2dc8-496f-8f83-d840b2e534aa tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:48.071053 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71a62744-4ea5-4dda-b32f-0b4e45022e0d req-3ee94509-d882-4021-86ec-529ad2a917e7 service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1558287
May 25 16:43:48.078841 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c96ac0-8b1f-431c-af4d-aa72067d083a req-068225b6-fd60-415d-a392-9b0091c51550 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:48.080821 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-56c96ac0-8b1f-431c-af4d-aa72067d083a req-068225b6-fd60-415d-a392-9b0091c51550 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.2001009
May 25 16:43:48.113997 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-912c9af4-2dc8-496f-8f83-d840b2e534aa tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks [] for floatingip, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:48.132602 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-912c9af4-2dc8-496f-8f83-d840b2e534aa tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:48.133859 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-912c9af4-2dc8-496f-8f83-d840b2e534aa tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] 10.222.0.73 "DELETE /v2.0/floatingips/b2dc0c55-8abb-41f2-815a-17cf5300c6f0 HTTP/1.1" status: 204  len: 168 time: 0.8884754
May 25 16:43:48.178477 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-56c96ac0-8b1f-431c-af4d-aa72067d083a req-90ba1499-b612-483b-848c-4b8e539b9136 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0893705
May 25 16:43:48.215339 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d1e7f5-8277-45e4-b61a-7932d8cd4dfd req-007a65bf-a987-4356-a304-00255d911849 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:48.216792 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-13d1e7f5-8277-45e4-b61a-7932d8cd4dfd req-007a65bf-a987-4356-a304-00255d911849 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=99ba5095326e4a449eb209304e90545f&device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 1096 time: 0.0895591
May 25 16:43:48.363676 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d1e7f5-8277-45e4-b61a-7932d8cd4dfd req-46791908-89af-4f7a-b3fc-9f40c3d80921 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:48.365305 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-13d1e7f5-8277-45e4-b61a-7932d8cd4dfd req-46791908-89af-4f7a-b3fc-9f40c3d80921 service neutron] 10.222.0.76 "GET /v2.0/networks?id=b95afcbb-a35f-4e21-a67d-e6712b2de87f HTTP/1.1" status: 200  len: 916 time: 0.1352031
May 25 16:43:48.443143 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-13d1e7f5-8277-45e4-b61a-7932d8cd4dfd req-0eae0c52-191b-445f-8435-788b8f2a64cb service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0266b6be-df05-4348-ad78-3c6b9cb56031 HTTP/1.1" status: 200  len: 217 time: 0.0677018
May 25 16:43:48.567002 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d1e7f5-8277-45e4-b61a-7932d8cd4dfd req-3c88d19b-624b-4ca9-9b58-e5cf7fc3c998 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:48.568444 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-13d1e7f5-8277-45e4-b61a-7932d8cd4dfd req-3c88d19b-624b-4ca9-9b58-e5cf7fc3c998 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=8641bb52-68d1-4215-b71c-1965a76b5e66 HTTP/1.1" status: 200  len: 854 time: 0.0610354
May 25 16:43:48.690223 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d1e7f5-8277-45e4-b61a-7932d8cd4dfd req-69fc6f4b-ad2a-4df1-a774-3d09d42d9e83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:48.691888 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-13d1e7f5-8277-45e4-b61a-7932d8cd4dfd req-69fc6f4b-ad2a-4df1-a774-3d09d42d9e83 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b95afcbb-a35f-4e21-a67d-e6712b2de87f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1065328
May 25 16:43:48.989481 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dacc3e9-7295-4809-832f-3bedcf88a16b req-2995c61c-4835-4478-acfa-e2ba9dfe125b tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:48.997437 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8dacc3e9-7295-4809-832f-3bedcf88a16b req-2995c61c-4835-4478-acfa-e2ba9dfe125b tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 943 time: 0.2934227
May 25 16:43:49.002746 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-13d1e7f5-8277-45e4-b61a-7932d8cd4dfd req-07b05530-df13-42d7-b47b-fd1e72e77e37 service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2735233
May 25 16:43:49.097693 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 5c47c017-af78-4c20-a79c-f54715856946 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:43:49.123530 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8dacc3e9-7295-4809-832f-3bedcf88a16b req-421d5f09-6eaa-4b64-93de-e1d0431feda2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1250846
May 25 16:43:49.200616 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-13d1e7f5-8277-45e4-b61a-7932d8cd4dfd req-43aa7cfc-cccb-430b-92d0-5e5697f90437 service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1702375
May 25 16:43:49.327194 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 5c47c017-af78-4c20-a79c-f54715856946, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=5c47c017-af78-4c20-a79c-f54715856946,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:49.343111 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '5c47c017-af78-4c20-a79c-f54715856946', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'port_id': '5c47c017-af78-4c20-a79c-f54715856946', 'mac_address': 'fa:16:3e:0b:6e:97', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 414, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:43:49.413186 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:49.414165 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-841c7e05-6844-4f03-92a9-be189ec4b86e req-939e6709-e3c9-4ea1-a4a6-a7959e6e4e6d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:49.416054 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-841c7e05-6844-4f03-92a9-be189ec4b86e req-939e6709-e3c9-4ea1-a4a6-a7959e6e4e6d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.1094501
May 25 16:43:49.440207 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 5c47c017-af78-4c20-a79c-f54715856946 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:43:49.462712 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 5c47c017-af78-4c20-a79c-f54715856946, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=5c47c017-af78-4c20-a79c-f54715856946,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:49.476440 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:49.480483 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-50391608-5b64-4b7b-8542-2baebb55b9c4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:49.482875 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-841c7e05-6844-4f03-92a9-be189ec4b86e req-1cc6e676-38ab-4e23-b9dc-4e6770770a41 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0524721
May 25 16:43:49.560334 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=5c47c017-af78-4c20-a79c-f54715856946,revision_number=6']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:49.569743 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:49.570088 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:49.570696 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:49.571272 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:49.571597 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:49.572010 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:49.572334 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:49.572914 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:49.573242 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:49.573679 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:49.573891 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:49.574218 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:49.578658 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:49.625387 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['5c47c017-af78-4c20-a79c-f54715856946'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:43:50.326028 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01bcab04-e857-4e06-a6c1-3e7abc8caf30 req-93a451ce-80be-4303-8b86-41b12f355929 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:50.327381 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-01bcab04-e857-4e06-a6c1-3e7abc8caf30 req-93a451ce-80be-4303-8b86-41b12f355929 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 943 time: 0.0868611
May 25 16:43:50.453008 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-01bcab04-e857-4e06-a6c1-3e7abc8caf30 req-3735b599-9159-4e1f-8676-deaa359cbfb5 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1181474
May 25 16:43:50.709167 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34bbc3ce-14d4-49d9-9231-c6b4bdf1d6db req-bcce0bc0-9f6f-4457-aaef-8d31410cde0e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:50.715098 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-34bbc3ce-14d4-49d9-9231-c6b4bdf1d6db req-bcce0bc0-9f6f-4457-aaef-8d31410cde0e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 944 time: 0.0979769
May 25 16:43:50.761297 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-34bbc3ce-14d4-49d9-9231-c6b4bdf1d6db req-b2f1d89e-d558-4ddd-90c6-56e5559bc69d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0452645
May 25 16:43:51.139499 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 0266b6be-df05-4348-ad78-3c6b9cb56031 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:43:51.150714 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 5c47c017-af78-4c20-a79c-f54715856946 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:51.329534 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 5c47c017-af78-4c20-a79c-f54715856946 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:51.330186 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:51.400760 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 0266b6be-df05-4348-ad78-3c6b9cb56031, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0266b6be-df05-4348-ad78-3c6b9cb56031,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:51.420207 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '0266b6be-df05-4348-ad78-3c6b9cb56031', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'port_id': '0266b6be-df05-4348-ad78-3c6b9cb56031', 'mac_address': 'fa:16:3e:cf:29:13', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 432, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:43:51.542969 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:51.573320 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:51.583938 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0266b6be-df05-4348-ad78-3c6b9cb56031 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:43:51.614484 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 0266b6be-df05-4348-ad78-3c6b9cb56031, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0266b6be-df05-4348-ad78-3c6b9cb56031,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:51.619925 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c47c017-af78-4c20-a79c-f54715856946'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:43:51.630494 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:51.633154 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:51.666347 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 5c47c017-af78-4c20-a79c-f54715856946, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=5c47c017-af78-4c20-a79c-f54715856946,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:51.682306 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:51.691666 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d078ebcb-1cd9-49ec-a98e-bd06b004a7d3 req-fc197b77-f95e-49ab-bdea-3ca41ff09de3 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:51.697418 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c47c017-af78-4c20-a79c-f54715856946', 'code': 200}
May 25 16:43:51.699946 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d078ebcb-1cd9-49ec-a98e-bd06b004a7d3 req-fc197b77-f95e-49ab-bdea-3ca41ff09de3 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 944 time: 0.1245131
May 25 16:43:51.715393 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=0266b6be-df05-4348-ad78-3c6b9cb56031,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:51.719708 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:51.720242 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-91ad3ce8-681d-44ff-9f1d-af538bc1271b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.027s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:51.759090 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d078ebcb-1cd9-49ec-a98e-bd06b004a7d3 req-36127b21-e817-4e3d-9c12-2e5af8611ff3 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0582662
May 25 16:43:51.812468 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=5c47c017-af78-4c20-a79c-f54715856946,revision_number=7']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:51.816433 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:51.953353 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['0266b6be-df05-4348-ad78-3c6b9cb56031'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:43:52.224924 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6b38432-c2bd-4581-a45d-33d182dc95a9 req-8c1aa9b2-f6c1-4882-af43-9505c6ad8807 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:52.227381 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f6b38432-c2bd-4581-a45d-33d182dc95a9 req-8c1aa9b2-f6c1-4882-af43-9505c6ad8807 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0996962
May 25 16:43:52.280011 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f6b38432-c2bd-4581-a45d-33d182dc95a9 req-224c0003-3573-438d-9ef5-7468b3657d9b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0459018
May 25 16:43:52.405926 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59434) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:52.989219 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d971b7a7-92df-4412-8b1b-68008e61efe8 req-05f96ccf-6b89-4a1c-bacc-112fd9aa5956 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:52.994122 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d971b7a7-92df-4412-8b1b-68008e61efe8 req-05f96ccf-6b89-4a1c-bacc-112fd9aa5956 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 944 time: 0.1095400
May 25 16:43:53.044418 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d971b7a7-92df-4412-8b1b-68008e61efe8 req-19b51d6e-4d7e-4f00-b42d-6647222fe6ee tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0464141
May 25 16:43:53.130011 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 0266b6be-df05-4348-ad78-3c6b9cb56031 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:43:53.206225 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 0266b6be-df05-4348-ad78-3c6b9cb56031 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:43:53.212426 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 0266b6be-df05-4348-ad78-3c6b9cb56031 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:43:53.212853 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:53.266442 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-501288'] for router_interface, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:53.387509 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:53.452737 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 0266b6be-df05-4348-ad78-3c6b9cb56031, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0266b6be-df05-4348-ad78-3c6b9cb56031,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:53.459377 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:53.462812 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:53.563070 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=0266b6be-df05-4348-ad78-3c6b9cb56031,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:53.569985 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:53.582804 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-988819ce-3174-435b-a475-998f9aa2082f req-5c42076c-c1ef-48df-a589-d333fcaaf48b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:53.592207 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-988819ce-3174-435b-a475-998f9aa2082f req-5c42076c-c1ef-48df-a589-d333fcaaf48b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.1480219
May 25 16:43:53.656541 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-988819ce-3174-435b-a475-998f9aa2082f req-f5b0f8b9-9de7-4a9d-981b-0ad19e4b8ef1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0632648
May 25 16:43:53.699219 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:43:53.746710 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031', 'code': 200}
May 25 16:43:53.841840 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Deleting port f4b0710d-b203-43ad-9bf9-b9df5851c043 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:43:53.842411 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:54.062092 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5af77f6f-32a0-4447-b191-1d4c847d0534 req-2ae5c2da-233c-4e7c-b6b3-5ede0c2badca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:54.063780 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5af77f6f-32a0-4447-b191-1d4c847d0534 req-2ae5c2da-233c-4e7c-b6b3-5ede0c2badca service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 1098 time: 0.1273584
May 25 16:43:54.106429 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] For port f4b0710d-b203-43ad-9bf9-b9df5851c043, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=f4b0710d-b203-43ad-9bf9-b9df5851c043,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:54.106429 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:54.165805 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5af77f6f-32a0-4447-b191-1d4c847d0534 req-ccc36fc8-d7a4-4384-8bf9-6d520588de1f service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0835848
May 25 16:43:54.257088 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Calling delete_port for f4b0710d-b203-43ad-9bf9-b9df5851c043 owned by network:router_interface {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:43:54.307075 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1202816f-0cfb-4f8c-9b35-f89d72315ec8 req-a2af35e9-b046-4420-bae7-c177d760c848 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:54.317849 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1202816f-0cfb-4f8c-9b35-f89d72315ec8 req-a2af35e9-b046-4420-bae7-c177d760c848 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 945 time: 0.1022475
May 25 16:43:54.379102 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1202816f-0cfb-4f8c-9b35-f89d72315ec8 req-b64eec57-202d-43dd-b2d6-3503a68282f3 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0590589
May 25 16:43:54.585248 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:54.589625 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-696ddabb-ed82-4b8f-9347-38a4a11e6622 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:54.640943 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Pushing event deleted for resources: {'Port': ['ID=f4b0710d-b203-43ad-9bf9-b9df5851c043,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:54.702929 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:54.703395 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:54.703839 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:54.704207 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:54.705388 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:54.705537 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:54.705915 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:54.706550 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:54.707128 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:54.707495 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:54.708743 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:54.708743 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:54.717838 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:54.910316 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca780023-13dc-42a7-909b-34eb8711998e req-72a53567-48aa-48be-964b-a184908357fa tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:54.919236 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ca780023-13dc-42a7-909b-34eb8711998e req-72a53567-48aa-48be-964b-a184908357fa tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.1359060
May 25 16:43:54.976522 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ca780023-13dc-42a7-909b-34eb8711998e req-39526d69-7055-4465-b384-ce893f2fe15e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0560653
May 25 16:43:55.041153 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1636838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-506040'] for router_interface, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:55.465875 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Router d0ffdac8-c8d7-4bac-8f41-858898f1783d has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:43:55.646203 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc2f8c3a-059f-45bd-a43b-af24b6a81636 req-45c98013-b3f9-4f8a-8c0e-991ad6f5c34b tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:55.648486 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bc2f8c3a-059f-45bd-a43b-af24b6a81636 req-45c98013-b3f9-4f8a-8c0e-991ad6f5c34b tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 945 time: 0.1415820
May 25 16:43:55.730104 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bc2f8c3a-059f-45bd-a43b-af24b6a81636 req-33e77e8e-7659-4867-83fd-de6eb6dd0348 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0757983
May 25 16:43:55.828357 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:43:55.839761 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64bbe554-cac5-458d-8bd8-562ee328d89f None None] Sync routers for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:43:55.849386 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] 10.222.0.73 "PUT /v2.0/routers/d0ffdac8-c8d7-4bac-8f41-858898f1783d/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.4401803
May 25 16:43:55.850475 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59458) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:55.854763 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64bbe554-cac5-458d-8bd8-562ee328d89f None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:55.855615 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-64bbe554-cac5-458d-8bd8-562ee328d89f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346ba9e760>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:56.030975 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76c84c73-19fc-4166-9138-6e288e41ef4b req-b5b6503e-00a2-49f8-b632-164b2e1baaaf tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:56.040089 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-76c84c73-19fc-4166-9138-6e288e41ef4b req-b5b6503e-00a2-49f8-b632-164b2e1baaaf tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 945 time: 0.1748993
May 25 16:43:56.085498 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Notify callbacks [] for router, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:56.120781 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-76c84c73-19fc-4166-9138-6e288e41ef4b req-6afdb52f-0c54-49f7-8fb0-c440e9c8252e tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0788898
May 25 16:43:56.212744 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-64bbe554-cac5-458d-8bd8-562ee328d89f None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:56.264388 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e47a534-7cac-4baf-9a70-52d3fa51a759 req-87a71931-3564-431f-b1c5-b4458ac64f79 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:56.272691 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0e47a534-7cac-4baf-9a70-52d3fa51a759 req-87a71931-3564-431f-b1c5-b4458ac64f79 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.1144516
May 25 16:43:56.346423 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:56.380664 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0e47a534-7cac-4baf-9a70-52d3fa51a759 req-55794efa-4385-4f8f-aa65-0228060253df tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.1070781
May 25 16:43:56.467084 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Deleting port bbc1c5c6-f690-4c0a-8371-dcdace27c48c {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:43:56.467507 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:56.653822 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] For port bbc1c5c6-f690-4c0a-8371-dcdace27c48c, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=bbc1c5c6-f690-4c0a-8371-dcdace27c48c,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:56.654346 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:56.724661 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-64bbe554-cac5-458d-8bd8-562ee328d89f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346ba9e760>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55'}], 'enable_snat': True}, 'gw_port_id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:43:54Z', 'revision_number': 5, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port': {'id': 'bbc1c5c6-f690-4c0a-8371-dcdace27c48c', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:40:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:37:21Z', 'updated_at': '2021-05-25T16:37:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:56.731423 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64bbe554-cac5-458d-8bd8-562ee328d89f None None] Checking router: d0ffdac8-c8d7-4bac-8f41-858898f1783d for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:43:56.742035 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64bbe554-cac5-458d-8bd8-562ee328d89f None None] Routers {'d0ffdac8-c8d7-4bac-8f41-858898f1783d'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:43:56.742662 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-64bbe554-cac5-458d-8bd8-562ee328d89f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346ba9e760>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:43:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:56.763366 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-268e954a-5572-497f-867c-f4927058fec4 req-cf2cd0f5-06ee-4ae7-9e42-94b4ad35eb97 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:56.765002 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-268e954a-5572-497f-867c-f4927058fec4 req-cf2cd0f5-06ee-4ae7-9e42-94b4ad35eb97 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 945 time: 0.0978494
May 25 16:43:56.810358 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Calling delete_port for bbc1c5c6-f690-4c0a-8371-dcdace27c48c owned by network:router_gateway {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:43:56.823424 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-268e954a-5572-497f-867c-f4927058fec4 req-a4aa1733-1a26-4e16-b43c-27f7335214f4 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0526240
May 25 16:43:56.929131 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-64bbe554-cac5-458d-8bd8-562ee328d89f None None] Set router d0ffdac8-c8d7-4bac-8f41-858898f1783d gateway port host: None {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:43:57.003423 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:57.012271 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-9c385db5-75d3-4f02-98b0-b752bcdc85a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:57.057479 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Pushing event deleted for resources: {'Port': ['ID=bbc1c5c6-f690-4c0a-8371-dcdace27c48c,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:57.064654 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:57.099097 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-64bbe554-cac5-458d-8bd8-562ee328d89f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346ba9e760>, [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:43:56Z', 'revision_number': 6, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port_host': None}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:57.105429 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64bbe554-cac5-458d-8bd8-562ee328d89f None None] The sync data for ids ['d0ffdac8-c8d7-4bac-8f41-858898f1783d'] in dv-cinder-786386-6-iscsi is: [{'id': 'd0ffdac8-c8d7-4bac-8f41-858898f1783d', 'name': 'tempest-AttachVolumeTestJSON-1213932814-router', 'tenant_id': '63f896ab0d7e44158204551033c33ba4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:37:19Z', 'updated_at': '2021-05-25T16:43:56Z', 'revision_number': 6, 'project_id': '63f896ab0d7e44158204551033c33ba4', 'gw_port_host': None}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:43:57.200925 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-501045'] for router_gateway, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:57.407948 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-507064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2357'] for router, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:57.411297 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:57.452932 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-507780'] for router, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:57.453480 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Fanout notify agent at l3_agent the message router_deleted on router d0ffdac8-c8d7-4bac-8f41-858898f1783d {{(pid=92012) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 16:43:57.471002 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Notify callbacks [] for router, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:57.476246 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 59478) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:57.499038 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] 10.222.0.73 "DELETE /v2.0/routers/d0ffdac8-c8d7-4bac-8f41-858898f1783d HTTP/1.1" status: 204  len: 168 time: 1.6461122
May 25 16:43:57.600998 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_v2 [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Deleting subnet 06161ba6-62a3-443f-9cfb-bccf3f60ad9c {{(pid=92013) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:43:57.607846 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:57.619256 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device f4b0710d-b203-43ad-9bf9-b9df5851c043 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:43:57.683309 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: f4b0710d-b203-43ad-9bf9-b9df5851c043 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:43:57.683309 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device f4b0710d-b203-43ad-9bf9-b9df5851c043 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:43:57.836225 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6928876'] for subnet, precommit_delete_associations {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:57.904854 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60fd6218-deaa-4466-a17b-7bc5cf168e1f req-f4e626a4-cfb0-487f-a306-a1861ea30f4b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:57.909879 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-60fd6218-deaa-4466-a17b-7bc5cf168e1f req-f4e626a4-cfb0-487f-a306-a1861ea30f4b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.2565303
May 25 16:43:58.073617 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-60fd6218-deaa-4466-a17b-7bc5cf168e1f req-6d2aeb82-3424-4c91-8650-9b1f67ae5b5a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.1548057
May 25 16:43:58.089018 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:58.401115 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6928756', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7156487'] for subnet, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:58.409266 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-88cb07f3-35f1-4454-9695-0c852b90c5dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:58.447348 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Notify callbacks [] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:58.451994 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-692419f7-032a-4571-b4bb-d34d37864281 None None] Network ce683266-622a-4b13-a610-301441bf2882 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:43:58.456546 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] 10.222.0.73 "DELETE /v2.0/subnets/06161ba6-62a3-443f-9cfb-bccf3f60ad9c HTTP/1.1" status: 204  len: 168 time: 0.9762530
May 25 16:43:58.456546 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=06161ba6-62a3-443f-9cfb-bccf3f60ad9c,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:58.459520 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59482) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:43:58.466277 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:58.466645 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:58.467011 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:58.467361 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:58.467709 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:58.468058 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:58.468426 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:58.468865 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:58.469435 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:58.470199 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:58.470199 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:58.471509 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:43:58.478508 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-0ef55d91-b8e8-455d-9731-5a6ca9e59a6c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:58.628616 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:43:58.631800 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:58.888186 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31d5b938-11b0-42b2-b744-6c8829cbd8ff None None] DHCP port deletion for ce683266-622a-4b13-a610-301441bf2882 request from dv-cinder-786386-6-iscsi {{(pid=92014) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 16:43:58.893663 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Deleting port e21e5b5b-f759-4197-8593-9926a21b96d8 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:43:58.894182 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:58.989235 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-31d5b938-11b0-42b2-b744-6c8829cbd8ff None None] Deleting port e21e5b5b-f759-4197-8593-9926a21b96d8 {{(pid=92014) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:43:58.989647 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-31d5b938-11b0-42b2-b744-6c8829cbd8ff None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:59.018505 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] For port e21e5b5b-f759-4197-8593-9926a21b96d8, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=e21e5b5b-f759-4197-8593-9926a21b96d8,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:59.020877 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:59.154005 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-31d5b938-11b0-42b2-b744-6c8829cbd8ff None None] For port e21e5b5b-f759-4197-8593-9926a21b96d8, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=e21e5b5b-f759-4197-8593-9926a21b96d8,segment=NetworkSegment(d81e37c9-589a-4925-890a-a746a946e185),segment_id=d81e37c9-589a-4925-890a-a746a946e185)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:43:59.154426 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-31d5b938-11b0-42b2-b744-6c8829cbd8ff None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:59.167417 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Calling delete_port for e21e5b5b-f759-4197-8593-9926a21b96d8 owned by network:dhcp {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:43:59.277873 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:59.282190 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:59.381865 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Pushing event deleted for resources: {'Port': ['ID=e21e5b5b-f759-4197-8593-9926a21b96d8,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:59.384985 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:59.385850 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] No DVR routers for this DVR port e21e5b5b-f759-4197-8593-9926a21b96d8 on host dv-cinder-786386-6-iscsi {{(pid=92012) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:43:59.484206 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-31d5b938-11b0-42b2-b744-6c8829cbd8ff None None] Calling delete_port for e21e5b5b-f759-4197-8593-9926a21b96d8 owned by network:dhcp {{(pid=92014) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:43:59.504068 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device bbc1c5c6-f690-4c0a-8371-dcdace27c48c no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:43:59.545569 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: bbc1c5c6-f690-4c0a-8371-dcdace27c48c {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:43:59.545923 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device bbc1c5c6-f690-4c0a-8371-dcdace27c48c not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:43:59.546344 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device e21e5b5b-f759-4197-8593-9926a21b96d8 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:43:59.551110 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b387cb4-44c3-40b5-ab84-5eee6a363398 req-4e36f2da-0e3d-43c6-8f51-4b97f57942d9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:43:59.561310 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b387cb4-44c3-40b5-ab84-5eee6a363398 req-4e36f2da-0e3d-43c6-8f51-4b97f57942d9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.2074873
May 25 16:43:59.570252 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:59.610423 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346aeba2b0>,) {'filters': {'network_id': ['ce683266-622a-4b13-a610-301441bf2882']}} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:59.632592 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346aeba2b0>, 'd81e37c9-589a-4925-890a-a746a946e185') {'for_net_delete': True} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:59.632938 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346aeba2b0>, 'd81e37c9-589a-4925-890a-a746a946e185') {} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:43:59.661964 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b387cb4-44c3-40b5-ab84-5eee6a363398 req-6a676a7e-a584-4c89-ab61-5765d9532d2c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0959721
May 25 16:43:59.665454 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-976068'] for segment, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:59.668789 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: e21e5b5b-f759-4197-8593-9926a21b96d8 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:43:59.669439 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device e21e5b5b-f759-4197-8593-9926a21b96d8 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:43:59.709310 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:59.717639 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Releasing vlan 430 on physical network physnet1 to pool {{(pid=92012) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:43:59.718045 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7823239'] for segment, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]: Traceback (most recent call last):
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     timer()
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     cb(*args, **kw)
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     return func(*args, **kwargs)
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     self._notify()
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     self.callback(batched_events)
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     event.method(event)
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     return f(self, *a, **k)
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._get(url).json()
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self.request(url, 'GET', **kwargs)
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:43:59.736843 dv-cinder-786386-6-iscsi neutron-server[92012]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:43:59.761777 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-31d5b938-11b0-42b2-b744-6c8829cbd8ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244'] for port, after_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:59.772846 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:59.876639 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:59.884503 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31d5b938-11b0-42b2-b744-6c8829cbd8ff None None] Pushing event deleted for resources: {'Port': ['ID=e21e5b5b-f759-4197-8593-9926a21b96d8,revision_number=None']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:59.886742 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31d5b938-11b0-42b2-b744-6c8829cbd8ff None None] No DVR routers for this DVR port e21e5b5b-f759-4197-8593-9926a21b96d8 on host dv-cinder-786386-6-iscsi {{(pid=92014) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:43:59.888079 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-31d5b938-11b0-42b2-b744-6c8829cbd8ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:59.899789 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:43:59.926327 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Pushing event deleted for resources: {'Network': ['ID=ce683266-622a-4b13-a610-301441bf2882,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:43:59.931911 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:43:59.936050 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:43:59.963961 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c2b3676f-5890-4249-a228-fe0948426003 admin admin] 10.222.0.73 "DELETE /v2.0/networks/ce683266-622a-4b13-a610-301441bf2882 HTTP/1.1" status: 204  len: 168 time: 1.5008731
May 25 16:44:00.103602 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59520) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:00.155548 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-011f6b7a-5cf0-47b3-a92a-512d417b01f5 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=63f896ab0d7e44158204551033c33ba4&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0506823
May 25 16:44:00.158713 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59526) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:00.217122 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f1522732-abe3-4892-a831-59e16a2a5f62 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:00.247074 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f1522732-abe3-4892-a831-59e16a2a5f62 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:00.307094 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f1522732-abe3-4892-a831-59e16a2a5f62 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:00.311812 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-da4547dd-03c2-4a94-8509-d386ece7185f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:00.325504 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1522732-abe3-4892-a831-59e16a2a5f62 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ace2ae0-ee6e-415e-a65a-ca8b6ff8de8f,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:00.327876 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f1522732-abe3-4892-a831-59e16a2a5f62 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:00.334359 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f1522732-abe3-4892-a831-59e16a2a5f62 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:00.335494 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f1522732-abe3-4892-a831-59e16a2a5f62 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/9ace2ae0-ee6e-415e-a65a-ca8b6ff8de8f HTTP/1.1" status: 204  len: 168 time: 0.1758718
May 25 16:44:00.843033 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61740edd-1e7c-4112-8198-0cd4e4777afe req-c6a87f7a-6d38-45f9-bd66-ee0095e00a04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:00.844966 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-61740edd-1e7c-4112-8198-0cd4e4777afe req-c6a87f7a-6d38-45f9-bd66-ee0095e00a04 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9c4a08443867402386f8ec58d2615739&device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 1098 time: 0.1190600
May 25 16:44:00.978188 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3404f8ad-7c3f-4b1c-bb89-8706b6835c4b req-96a13919-2c20-4c5d-b999-8a8f4fd3bdc6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:00.979692 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3404f8ad-7c3f-4b1c-bb89-8706b6835c4b req-96a13919-2c20-4c5d-b999-8a8f4fd3bdc6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.1916180
May 25 16:44:01.030752 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61740edd-1e7c-4112-8198-0cd4e4777afe req-1e7a846a-c5e1-4ebb-824e-fb29a16b3dfc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:01.033110 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-61740edd-1e7c-4112-8198-0cd4e4777afe req-1e7a846a-c5e1-4ebb-824e-fb29a16b3dfc service neutron] 10.222.0.76 "GET /v2.0/networks?id=b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 200  len: 918 time: 0.1799545
May 25 16:44:01.127540 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3404f8ad-7c3f-4b1c-bb89-8706b6835c4b req-3b133729-a00f-4fd7-acb6-a7e640d650fa tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.1379480
May 25 16:44:01.163703 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-61740edd-1e7c-4112-8198-0cd4e4777afe req-e115c0fa-e5e6-4886-8757-3de9724b1ffd service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5c47c017-af78-4c20-a79c-f54715856946 HTTP/1.1" status: 200  len: 1000 time: 0.1223872
May 25 16:44:01.243793 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61740edd-1e7c-4112-8198-0cd4e4777afe req-c2181c49-e53e-4572-8bc1-89b2412d542c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:01.245358 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-61740edd-1e7c-4112-8198-0cd4e4777afe req-c2181c49-e53e-4572-8bc1-89b2412d542c service neutron] 10.222.0.76 "GET /v2.0/subnets?id=950695d6-8663-4ed4-92fd-b43d8ea5a820 HTTP/1.1" status: 200  len: 856 time: 0.0747452
May 25 16:44:01.329118 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61740edd-1e7c-4112-8198-0cd4e4777afe req-b3e95fbb-5684-429a-bf63-f754eb49a356 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:01.330939 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-61740edd-1e7c-4112-8198-0cd4e4777afe req-b3e95fbb-5684-429a-bf63-f754eb49a356 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b8cabc9a-0f6f-485c-8020-441b42ac019b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0788679
May 25 16:44:01.429609 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-06afc8cd-971e-49f7-8bc3-9fd44418a7e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:01.475483 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-61740edd-1e7c-4112-8198-0cd4e4777afe req-eb740b7a-1d37-4388-bae6-8484133b4908 service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1368561
May 25 16:44:01.612566 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-61740edd-1e7c-4112-8198-0cd4e4777afe req-b7e604db-72b2-4849-acd6-0338b3dcc662 service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1303866
May 25 16:44:02.337595 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfe6e046-77ed-4fc7-806e-058f952970c4 req-fb69c7ce-6917-4216-b4ab-da92d689a93a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:02.339052 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dfe6e046-77ed-4fc7-806e-058f952970c4 req-fb69c7ce-6917-4216-b4ab-da92d689a93a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0893664
May 25 16:44:02.383922 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dfe6e046-77ed-4fc7-806e-058f952970c4 req-1eba3c52-25f6-457a-a8fa-c40aee82ddb2 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0387096
May 25 16:44:03.599658 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f34a292b-73c2-4a41-9316-f61c1c0469e9 req-0efa481d-ed95-44c5-9b57-12c9475beeef tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:03.601931 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f34a292b-73c2-4a41-9316-f61c1c0469e9 req-0efa481d-ed95-44c5-9b57-12c9475beeef tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0937769
May 25 16:44:03.732291 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f34a292b-73c2-4a41-9316-f61c1c0469e9 req-621298b6-2ea5-4a99-9ea7-3937fb710aa1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.1255567
May 25 16:44:03.842865 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:04.110644 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b5e6cedd-5357-43fa-8e4c-40b764fceb20 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:04.924992 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df2de7c9-4dcc-4680-ac87-aa771027f8a8 req-19ad0fa1-e629-43a6-b508-5595672a5daf tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:04.926475 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-df2de7c9-4dcc-4680-ac87-aa771027f8a8 req-19ad0fa1-e629-43a6-b508-5595672a5daf tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 945 time: 0.0863843
May 25 16:44:04.973259 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-df2de7c9-4dcc-4680-ac87-aa771027f8a8 req-b72a06ee-8b89-4af4-b104-7e6d00549979 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0404942
May 25 16:44:05.066851 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:05.169822 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 5c47c017-af78-4c20-a79c-f54715856946 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:44:05.263010 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59638) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:05.289389 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:05.319585 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '5c47c017-af78-4c20-a79c-f54715856946'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:44:05.330669 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 5c47c017-af78-4c20-a79c-f54715856946, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=5c47c017-af78-4c20-a79c-f54715856946,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:44:05.335400 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:05.337884 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:05.382372 dv-cinder-786386-6-iscsi neutron-server[92014]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '5c47c017-af78-4c20-a79c-f54715856946', 'code': 422} returned with failed status
May 25 16:44:05.395917 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0933d3d6-2824-4ad0-b2db-13fe69f49e99 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:05.412249 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-0933d3d6-2824-4ad0-b2db-13fe69f49e99 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:05.416539 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-0933d3d6-2824-4ad0-b2db-13fe69f49e99 admin admin] Usage tracker for resource:security_group_rule and tenant:18968944e6d04d7cb39b872a4ac410bc is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:05.418436 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=5c47c017-af78-4c20-a79c-f54715856946,revision_number=8']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:05.419822 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-0933d3d6-2824-4ad0-b2db-13fe69f49e99 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:05.425986 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-0933d3d6-2824-4ad0-b2db-13fe69f49e99 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:05.428361 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:05.513642 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0933d3d6-2824-4ad0-b2db-13fe69f49e99 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:05.521689 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0933d3d6-2824-4ad0-b2db-13fe69f49e99 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:05.529841 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-8d1dea34-6618-4a94-9448-2b33aee24011 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:05.573275 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-0933d3d6-2824-4ad0-b2db-13fe69f49e99 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=18968944e6d04d7cb39b872a4ac410bc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3091364
May 25 16:44:05.574536 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0933d3d6-2824-4ad0-b2db-13fe69f49e99 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d3dd51b-2ccf-43ce-bafd-b43868dce25f,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:05.575511 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 59652) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:05.578404 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0933d3d6-2824-4ad0-b2db-13fe69f49e99 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:05.648952 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-13cbd0ae-b819-42f6-a479-50585b5ef0bf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:05.674922 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-13cbd0ae-b819-42f6-a479-50585b5ef0bf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:05.731991 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-13cbd0ae-b819-42f6-a479-50585b5ef0bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:05.736390 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-7ef550df-f7b3-4c58-a605-33005554c3f3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:05.750066 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13cbd0ae-b819-42f6-a479-50585b5ef0bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d3dd51b-2ccf-43ce-bafd-b43868dce25f,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:05.753227 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-13cbd0ae-b819-42f6-a479-50585b5ef0bf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:05.755253 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-13cbd0ae-b819-42f6-a479-50585b5ef0bf admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:05.759203 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-13cbd0ae-b819-42f6-a479-50585b5ef0bf admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/7d3dd51b-2ccf-43ce-bafd-b43868dce25f HTTP/1.1" status: 204  len: 168 time: 0.1825733
May 25 16:44:06.052502 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 59666) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:06.070128 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-87d6e840-1f1d-4ac1-9afa-9df19dbd0c79 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:06.084261 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-87d6e840-1f1d-4ac1-9afa-9df19dbd0c79 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:06.088303 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-87d6e840-1f1d-4ac1-9afa-9df19dbd0c79 admin admin] Usage tracker for resource:security_group_rule and tenant:9e9e8b77dcd940a2b2aacb2d78d98f2d is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:06.091241 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-87d6e840-1f1d-4ac1-9afa-9df19dbd0c79 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:06.098208 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-87d6e840-1f1d-4ac1-9afa-9df19dbd0c79 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:06.197840 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-87d6e840-1f1d-4ac1-9afa-9df19dbd0c79 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:06.202111 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-87d6e840-1f1d-4ac1-9afa-9df19dbd0c79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:06.209631 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-bd74af00-a8c7-4388-94ec-dc9c4aad8713 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:06.252785 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-87d6e840-1f1d-4ac1-9afa-9df19dbd0c79 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=9e9e8b77dcd940a2b2aacb2d78d98f2d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1969345
May 25 16:44:06.252785 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87d6e840-1f1d-4ac1-9afa-9df19dbd0c79 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f041928-cbf1-44e3-ab22-8ce0a6f51146,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:06.253591 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59672) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:06.254508 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-87d6e840-1f1d-4ac1-9afa-9df19dbd0c79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:06.313788 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1c4de4ae-cb09-4bba-b464-e4f331c3f684 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:06.346050 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1c4de4ae-cb09-4bba-b464-e4f331c3f684 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:06.401552 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1c4de4ae-cb09-4bba-b464-e4f331c3f684 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:06.406428 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ffb35855-b3f3-4c08-acfc-73f9ef7c9237 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:06.420354 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c4de4ae-cb09-4bba-b464-e4f331c3f684 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f041928-cbf1-44e3-ab22-8ce0a6f51146,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:06.423253 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-1c4de4ae-cb09-4bba-b464-e4f331c3f684 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:06.431348 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1c4de4ae-cb09-4bba-b464-e4f331c3f684 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:06.435294 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-1c4de4ae-cb09-4bba-b464-e4f331c3f684 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/6f041928-cbf1-44e3-ab22-8ce0a6f51146 HTTP/1.1" status: 204  len: 168 time: 0.1783841
May 25 16:44:06.601550 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:06.698540 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb876c3a-76d9-4377-830a-3d10d7a94011 req-6dfd8998-ff7c-4659-a25e-7ca7db8f5e4e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:06.701892 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bb876c3a-76d9-4377-830a-3d10d7a94011 req-6dfd8998-ff7c-4659-a25e-7ca7db8f5e4e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.1028006
May 25 16:44:06.726266 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-81bd235a-2a7e-4558-88c9-57cd5c5c80c3 service neutron] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1104381
May 25 16:44:06.754159 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bb876c3a-76d9-4377-830a-3d10d7a94011 req-46d206ee-f25c-45e9-9298-12190bf6fc8f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0467701
May 25 16:44:07.647091 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-dd26f471-4e5c-414b-9594-58f44b6c30fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:07.648612 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-dd26f471-4e5c-414b-9594-58f44b6c30fc service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f&tenant_id=9c4a08443867402386f8ec58d2615739 HTTP/1.1" status: 200  len: 1096 time: 0.0716004
May 25 16:44:07.749999 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-89f41035-ed9f-47e1-8d54-92f8088a9b5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:07.751544 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-89f41035-ed9f-47e1-8d54-92f8088a9b5e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=9c4a08443867402386f8ec58d2615739&device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 1096 time: 0.0791662
May 25 16:44:07.961649 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-f73af6b3-bfff-4b23-b556-d62803d708fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:07.963111 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-f73af6b3-bfff-4b23-b556-d62803d708fb service neutron] 10.222.0.76 "GET /v2.0/networks?id=b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 200  len: 918 time: 0.2040327
May 25 16:44:08.064760 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-755bbb10-11c8-4a16-84f9-99c98efd14cd req-81a48f94-e1e8-4cdd-b8b9-3c77e8a5480d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:08.066174 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-755bbb10-11c8-4a16-84f9-99c98efd14cd req-81a48f94-e1e8-4cdd-b8b9-3c77e8a5480d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.1950476
May 25 16:44:08.145540 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-9db09825-020e-487b-8c1e-4892de2dfce0 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5c47c017-af78-4c20-a79c-f54715856946 HTTP/1.1" status: 200  len: 998 time: 0.1744797
May 25 16:44:08.222951 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-755bbb10-11c8-4a16-84f9-99c98efd14cd req-124c4b40-3987-4c57-95f5-7515afbc709f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.1477456
May 25 16:44:08.241567 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-ac8f1b6c-9a0d-46bb-aa0f-300c28466b3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:08.243030 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-ac8f1b6c-9a0d-46bb-aa0f-300c28466b3b service neutron] 10.222.0.76 "GET /v2.0/subnets?id=950695d6-8663-4ed4-92fd-b43d8ea5a820 HTTP/1.1" status: 200  len: 856 time: 0.0845699
May 25 16:44:08.316894 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe85df30-78ed-4478-abb7-88b1ee860f57 req-795a6491-fc87-47d7-87dd-36552c06a5c4 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:08.318390 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fe85df30-78ed-4478-abb7-88b1ee860f57 req-795a6491-fc87-47d7-87dd-36552c06a5c4 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 945 time: 0.2467711
May 25 16:44:08.374374 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fe85df30-78ed-4478-abb7-88b1ee860f57 req-2a085416-163c-428d-90fb-1e646d5c1614 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0483596
May 25 16:44:08.377110 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-8af72317-096c-4e3d-85fe-ab58eeff3988 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:08.378454 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-8af72317-096c-4e3d-85fe-ab58eeff3988 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b8cabc9a-0f6f-485c-8020-441b42ac019b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1286392
May 25 16:44:08.403769 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59752) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:08.517497 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-a7543b33-a0bb-46f3-b285-5ecbd88d8798 service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1316950
May 25 16:44:08.660836 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-41bc65b8-067f-463e-b6ef-39d3fd9c73df req-095e5456-a04e-4f45-a50c-242e73994613 service neutron] 10.222.0.76 "GET /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1359065
May 25 16:44:08.685267 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70158909-42bf-4fe4-938c-7c78d7b18860 tempest-TestMinimumBasicScenario-104883393 tempest-TestMinimumBasicScenario-104883393-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:08.689731 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-70158909-42bf-4fe4-938c-7c78d7b18860 tempest-TestMinimumBasicScenario-104883393 tempest-TestMinimumBasicScenario-104883393-project-admin] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 1093 time: 0.2822690
May 25 16:44:08.690576 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 59766) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:08.696870 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Request body: {'floatingip': {'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'port_id': '0266b6be-df05-4348-ad78-3c6b9cb56031', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'fixed_ip_address': '172.20.0.8'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:44:08.703997 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:08.707708 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Usage tracker for resource:floatingip and tenant:99ba5095326e4a449eb209304e90545f is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:08.711345 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:08.717679 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:08.731068 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for floatingip, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:08.870721 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:09.137052 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Allocated IP 172.27.3.214 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/b3cf4b67-e312-452e-b653-cf699cccc62c) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:44:09.363440 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:09.475646 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03253a42-c6a8-49bc-a7c4-5cb947323aa7 req-ace93d0e-7ece-4a5d-a204-6ae6773e96fd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:09.477161 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-03253a42-c6a8-49bc-a7c4-5cb947323aa7 req-ace93d0e-7ece-4a5d-a204-6ae6773e96fd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.1064217
May 25 16:44:09.478735 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:09.483572 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:09.512234 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59804) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:09.570616 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:44:09.575362 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:44:09.582952 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:44:09.631215 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event updated for resources: {'Port': ['ID=b3cf4b67-e312-452e-b653-cf699cccc62c,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:09.638412 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:09.659927 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-03253a42-c6a8-49bc-a7c4-5cb947323aa7 req-da993f8f-a96b-4951-a4bd-908f77098a54 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.1400712
May 25 16:44:09.706392 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3986e6da-fd82-4461-8612-0a0a93167633 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:09.725592 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-3986e6da-fd82-4461-8612-0a0a93167633 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:09.734370 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-3986e6da-fd82-4461-8612-0a0a93167633 admin admin] Usage tracker for resource:security_group_rule and tenant:66e161b8e7054d51aef8c7f8d109176f is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:09.744676 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-3986e6da-fd82-4461-8612-0a0a93167633 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:09.754113 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-3986e6da-fd82-4461-8612-0a0a93167633 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:09.897575 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3986e6da-fd82-4461-8612-0a0a93167633 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:09.901630 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-3986e6da-fd82-4461-8612-0a0a93167633 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:09.909092 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-afba03b5-9cff-4d89-b5ea-ed167ca0c1b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:09.942345 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-3986e6da-fd82-4461-8612-0a0a93167633 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=66e161b8e7054d51aef8c7f8d109176f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4284365
May 25 16:44:09.949504 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59810) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:09.971731 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3986e6da-fd82-4461-8612-0a0a93167633 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=442298e8-3e46-4303-be1c-13bdcfc0e618,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:09.974744 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3986e6da-fd82-4461-8612-0a0a93167633 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:10.022854 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-59e8ec59-f200-4434-8af3-a0ac8cd82d2e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.057096 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-59e8ec59-f200-4434-8af3-a0ac8cd82d2e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.117353 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-59e8ec59-f200-4434-8af3-a0ac8cd82d2e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.122356 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2836a0d8-2b34-43a3-960e-2ab0ec109347 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:10.135192 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59e8ec59-f200-4434-8af3-a0ac8cd82d2e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=442298e8-3e46-4303-be1c-13bdcfc0e618,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:10.135363 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.137749 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-59e8ec59-f200-4434-8af3-a0ac8cd82d2e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:10.138918 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-59e8ec59-f200-4434-8af3-a0ac8cd82d2e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.139995 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-59e8ec59-f200-4434-8af3-a0ac8cd82d2e admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/442298e8-3e46-4303-be1c-13bdcfc0e618 HTTP/1.1" status: 204  len: 168 time: 0.1894741
May 25 16:44:10.244672 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.483131 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59820) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:10.484045 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.493027 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.497781 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:10.506875 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5fd8460d-0b95-4755-b4c4-91d1bd87511f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.523885 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-5fd8460d-0b95-4755-b4c4-91d1bd87511f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:10.527706 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-5fd8460d-0b95-4755-b4c4-91d1bd87511f admin admin] Usage tracker for resource:security_group_rule and tenant:74c8056a67114b319f3d81c84ceffaf2 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:10.530529 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-5fd8460d-0b95-4755-b4c4-91d1bd87511f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:10.536243 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-5fd8460d-0b95-4755-b4c4-91d1bd87511f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:10.614183 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event updated for resources: {'Port': ['ID=b3cf4b67-e312-452e-b653-cf699cccc62c,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:10.618538 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:10.624303 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.638877 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5fd8460d-0b95-4755-b4c4-91d1bd87511f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.644401 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5fd8460d-0b95-4755-b4c4-91d1bd87511f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.660356 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0933d3d6-2824-4ad0-b2db-13fe69f49e99 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:10.698510 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fd8460d-0b95-4755-b4c4-91d1bd87511f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e18d6907-b499-4004-a604-20352e10ee19,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:10.714485 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-5fd8460d-0b95-4755-b4c4-91d1bd87511f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:10.718247 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-5fd8460d-0b95-4755-b4c4-91d1bd87511f admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=74c8056a67114b319f3d81c84ceffaf2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2338212
May 25 16:44:10.725986 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59828) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:10.802126 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ae1f37dd-dc2f-40bd-9f65-cf57703679fa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.835819 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ae1f37dd-dc2f-40bd-9f65-cf57703679fa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.916136 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ae1f37dd-dc2f-40bd-9f65-cf57703679fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.919102 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.l3_db [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Floating IP 7ca10b76-66b9-4a27-9ad6-a462e20dc32d associated. External IP: 172.27.3.214, port: 0266b6be-df05-4348-ad78-3c6b9cb56031.
May 25 16:44:10.920528 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-39cc1bd6-8e02-44aa-b0a3-cab42a074313 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:10.939628 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae1f37dd-dc2f-40bd-9f65-cf57703679fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e18d6907-b499-4004-a604-20352e10ee19,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:10.948211 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ae1f37dd-dc2f-40bd-9f65-cf57703679fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:10.949424 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-ae1f37dd-dc2f-40bd-9f65-cf57703679fa admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:10.950531 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-ae1f37dd-dc2f-40bd-9f65-cf57703679fa admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/e18d6907-b499-4004-a604-20352e10ee19 HTTP/1.1" status: 204  len: 168 time: 0.2231712
May 25 16:44:11.142094 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4e22681-356e-4e45-a767-744a63733df2 req-0a13d40e-2ae9-40a0-b3d6-7eb59b5fb550 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:11.143807 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d4e22681-356e-4e45-a767-744a63733df2 req-0a13d40e-2ae9-40a0-b3d6-7eb59b5fb550 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.3217106
May 25 16:44:11.283809 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d4e22681-356e-4e45-a767-744a63733df2 req-f4e35119-39d9-461b-857d-df3f70247125 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0812004
May 25 16:44:11.524314 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:44:11.742457 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:44:11.758000 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f2f4166-b450-4f1d-af61-806da1d77abb None None] Sync routers for ids ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:44:11.773805 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f2f4166-b450-4f1d-af61-806da1d77abb None None] Routers {'eedeb3fa-21be-40a8-bc7a-e35e532db9c4'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:44:11.774713 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-8f2f4166-b450-4f1d-af61-806da1d77abb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b988d00>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:44:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:44:11.776831 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:11.843363 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 3.1491570
May 25 16:44:11.843363 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:44:11.843686 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59850) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:11.849067 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1771185305', 'description': 'tempest-secgroup-smoke-1771185305 description', 'project_id': '99ba5095326e4a449eb209304e90545f'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:44:11.855348 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:11.860231 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Usage tracker for resource:security_group and tenant:99ba5095326e4a449eb209304e90545f is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:11.863363 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:11.871018 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:11.895898 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:11.930642 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031', 'status': 'completed', 'code': 200}
May 25 16:44:11.933594 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:11.947414 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Usage tracker for resource:security_group_rule and tenant:99ba5095326e4a449eb209304e90545f is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:11.950618 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:11.956612 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:12.035613 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-8f2f4166-b450-4f1d-af61-806da1d77abb None None] Set router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:44:12.076907 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:12.084773 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:12.088797 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ecb0be0f-43dd-4c8b-920d-da5206d420de admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:12.152604 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event updated for resources: {'SecurityGroup': ['ID=772f7160-6018-4856-bef5-ffd50932ea20,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:12.155587 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:12.159940 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:12.161052 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.3163097
May 25 16:44:12.164495 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 59862) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:12.171565 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-ba8858ca-a010-4447-8f09-4eb5d7d64633 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Request body: {'security_group_rule': {'security_group_id': '772f7160-6018-4856-bef5-ffd50932ea20', 'project_id': '99ba5095326e4a449eb209304e90545f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:44:12.180269 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-ba8858ca-a010-4447-8f09-4eb5d7d64633 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:12.185545 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-ba8858ca-a010-4447-8f09-4eb5d7d64633 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Usage tracker for resource:security_group_rule and tenant:99ba5095326e4a449eb209304e90545f is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:12.191116 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-ba8858ca-a010-4447-8f09-4eb5d7d64633 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:12.199147 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-ba8858ca-a010-4447-8f09-4eb5d7d64633 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:12.230632 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ba8858ca-a010-4447-8f09-4eb5d7d64633 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:12.328300 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ba8858ca-a010-4447-8f09-4eb5d7d64633 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:12.336629 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ba8858ca-a010-4447-8f09-4eb5d7d64633 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:12.339661 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-384ea19f-c1ea-490e-aaa1-ec7984d5f7b3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:12.422562 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba8858ca-a010-4447-8f09-4eb5d7d64633 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b06248b8-d303-4833-9ae1-43d159432a6f,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:12.434812 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ba8858ca-a010-4447-8f09-4eb5d7d64633 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:12.518540 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ba8858ca-a010-4447-8f09-4eb5d7d64633 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:12.522864 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59868) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:12.523070 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-ba8858ca-a010-4447-8f09-4eb5d7d64633 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3573112
May 25 16:44:12.529108 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-78afe2dd-5395-448a-ab5a-e2ac8715ec21 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Request body: {'security_group_rule': {'security_group_id': '772f7160-6018-4856-bef5-ffd50932ea20', 'project_id': '99ba5095326e4a449eb209304e90545f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:44:12.539114 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-8f2f4166-b450-4f1d-af61-806da1d77abb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b988d00>, [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97'}], 'enable_snat': True}, 'gw_port_id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:43:08Z', 'revision_number': 4, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port': {'id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:29:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:03Z', 'updated_at': '2021-05-25T16:43:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '7ca10b76-66b9-4a27-9ad6-a462e20dc32d', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'floating_ip_address': '172.27.3.214', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'port_id': '0266b6be-df05-4348-ad78-3c6b9cb56031', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 592, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'mac_address': 'fa:16:3e:cf:29:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:44:10Z', 'updated_at': '2021-05-25T16:44:10Z', 'revision_number': 0, 'project_id': '99ba5095326e4a449eb209304e90545f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dfc3005c-08e6-444a-9b5b-ae177a8dc3e1', 'name': '', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'mac_address': 'fa:16:3e:6d:34:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_interface', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:07Z', 'updated_at': '2021-05-25T16:43:14Z', 'revision_number': 5, 'project_id': '99ba5095326e4a449eb209304e90545f', 'subnets': [{'id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:44:12.540426 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-78afe2dd-5395-448a-ab5a-e2ac8715ec21 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:12.545183 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f2f4166-b450-4f1d-af61-806da1d77abb None None] Checking router: eedeb3fa-21be-40a8-bc7a-e35e532db9c4 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:44:12.549655 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-78afe2dd-5395-448a-ab5a-e2ac8715ec21 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Usage tracker for resource:security_group_rule and tenant:99ba5095326e4a449eb209304e90545f is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:12.559529 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-78afe2dd-5395-448a-ab5a-e2ac8715ec21 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:12.566975 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-78afe2dd-5395-448a-ab5a-e2ac8715ec21 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:12.570557 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f2f4166-b450-4f1d-af61-806da1d77abb None None] Routers {'eedeb3fa-21be-40a8-bc7a-e35e532db9c4'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:44:12.571350 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-8f2f4166-b450-4f1d-af61-806da1d77abb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b988d00>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:44:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:44:12.584583 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675ec8df-380d-456c-bb4f-d550d75e322b req-a2e1d34a-7094-4146-9d0a-83543bc3b64e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:12.586737 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-675ec8df-380d-456c-bb4f-d550d75e322b req-a2e1d34a-7094-4146-9d0a-83543bc3b64e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.1536775
May 25 16:44:12.594914 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-78afe2dd-5395-448a-ab5a-e2ac8715ec21 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:12.648920 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-675ec8df-380d-456c-bb4f-d550d75e322b req-3d36e14f-d6d0-4233-9ca2-f5ef0ac5dada tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0562389
May 25 16:44:12.858386 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-78afe2dd-5395-448a-ab5a-e2ac8715ec21 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:12.873853 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-78afe2dd-5395-448a-ab5a-e2ac8715ec21 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:12.877322 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:12.951948 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78afe2dd-5395-448a-ab5a-e2ac8715ec21 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0801c37a-7f82-4218-b2dc-6198b5302be5,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:12.963829 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-78afe2dd-5395-448a-ab5a-e2ac8715ec21 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:12.964978 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-78afe2dd-5395-448a-ab5a-e2ac8715ec21 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:12.966275 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-78afe2dd-5395-448a-ab5a-e2ac8715ec21 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.4423797
May 25 16:44:12.972198 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 59878) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:12.992325 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-e652776b-a0f1-45a2-add6-ffa075ec684a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Request body: {'security_group_rule': {'security_group_id': '772f7160-6018-4856-bef5-ffd50932ea20', 'project_id': '99ba5095326e4a449eb209304e90545f', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:44:13.010618 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-e652776b-a0f1-45a2-add6-ffa075ec684a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:13.014848 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-e652776b-a0f1-45a2-add6-ffa075ec684a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Usage tracker for resource:security_group_rule and tenant:99ba5095326e4a449eb209304e90545f is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:13.019012 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-e652776b-a0f1-45a2-add6-ffa075ec684a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:13.033611 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-e652776b-a0f1-45a2-add6-ffa075ec684a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:13.046602 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-8f2f4166-b450-4f1d-af61-806da1d77abb None None] Set router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:44:13.060089 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e652776b-a0f1-45a2-add6-ffa075ec684a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.139705 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e652776b-a0f1-45a2-add6-ffa075ec684a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.147234 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e652776b-a0f1-45a2-add6-ffa075ec684a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.150534 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-88f020c7-3c10-4314-9b83-b220735bede8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:13.169182 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e652776b-a0f1-45a2-add6-ffa075ec684a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e3572722-d475-4804-a37b-6ebcbb4ee83d,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:13.172622 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-e652776b-a0f1-45a2-add6-ffa075ec684a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:13.187971 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e652776b-a0f1-45a2-add6-ffa075ec684a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.188856 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-e652776b-a0f1-45a2-add6-ffa075ec684a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2150357
May 25 16:44:13.191846 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59882) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:13.200190 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-a73c7aa7-b466-4922-8c44-b6e18675e439 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Request body: {'security_group_rule': {'security_group_id': '772f7160-6018-4856-bef5-ffd50932ea20', 'project_id': '99ba5095326e4a449eb209304e90545f', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:44:13.207484 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a73c7aa7-b466-4922-8c44-b6e18675e439 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:13.213574 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a73c7aa7-b466-4922-8c44-b6e18675e439 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Usage tracker for resource:security_group_rule and tenant:99ba5095326e4a449eb209304e90545f is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:13.217586 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-a73c7aa7-b466-4922-8c44-b6e18675e439 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:13.232470 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-a73c7aa7-b466-4922-8c44-b6e18675e439 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:13.249792 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a73c7aa7-b466-4922-8c44-b6e18675e439 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.331749 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a73c7aa7-b466-4922-8c44-b6e18675e439 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.338503 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a73c7aa7-b466-4922-8c44-b6e18675e439 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.347146 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-d6cc8a42-ab82-47c8-b2b6-b85be6c9fce9 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:13.382177 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a73c7aa7-b466-4922-8c44-b6e18675e439 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=32d06727-863b-448a-9f79-9040040807b3,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:13.385471 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a73c7aa7-b466-4922-8c44-b6e18675e439 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:13.390260 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a73c7aa7-b466-4922-8c44-b6e18675e439 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.391501 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-a73c7aa7-b466-4922-8c44-b6e18675e439 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.1986835
May 25 16:44:13.394338 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 59886) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:13.400041 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-44160f60-614f-44e9-83e3-cfff9da6faa2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Request body: {'security_group_rule': {'security_group_id': '772f7160-6018-4856-bef5-ffd50932ea20', 'project_id': '99ba5095326e4a449eb209304e90545f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:44:13.406275 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-44160f60-614f-44e9-83e3-cfff9da6faa2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:13.410664 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-44160f60-614f-44e9-83e3-cfff9da6faa2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Usage tracker for resource:security_group_rule and tenant:99ba5095326e4a449eb209304e90545f is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:13.413833 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-44160f60-614f-44e9-83e3-cfff9da6faa2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:13.420372 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-44160f60-614f-44e9-83e3-cfff9da6faa2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:13.438898 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.securitygroups_db [None req-44160f60-614f-44e9-83e3-cfff9da6faa2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Project 99ba5095326e4a449eb209304e90545f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 25 16:44:13.446976 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-44160f60-614f-44e9-83e3-cfff9da6faa2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.466203 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-8f2f4166-b450-4f1d-af61-806da1d77abb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b988d00>, [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97'}], 'enable_snat': True}, 'gw_port_id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:43:08Z', 'revision_number': 4, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port': {'id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:29:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:03Z', 'updated_at': '2021-05-25T16:43:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '7ca10b76-66b9-4a27-9ad6-a462e20dc32d', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'floating_ip_address': '172.27.3.214', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'port_id': '0266b6be-df05-4348-ad78-3c6b9cb56031', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 592, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'mac_address': 'fa:16:3e:cf:29:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:44:10Z', 'updated_at': '2021-05-25T16:44:10Z', 'revision_number': 0, 'project_id': '99ba5095326e4a449eb209304e90545f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dfc3005c-08e6-444a-9b5b-ae177a8dc3e1', 'name': '', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'mac_address': 'fa:16:3e:6d:34:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_interface', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:07Z', 'updated_at': '2021-05-25T16:43:14Z', 'revision_number': 5, 'project_id': '99ba5095326e4a449eb209304e90545f', 'subnets': [{'id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:44:13.471440 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f2f4166-b450-4f1d-af61-806da1d77abb None None] The sync data for ids ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'] in dv-cinder-786386-6-iscsi is: [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97'}], 'enable_snat': True}, 'gw_port_id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:43:08Z', 'revision_number': 4, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port': {'id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:29:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:03Z', 'updated_at': '2021-05-25T16:43:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '7ca10b76-66b9-4a27-9ad6-a462e20dc32d', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'floating_ip_address': '172.27.3.214', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'port_id': '0266b6be-df05-4348-ad78-3c6b9cb56031', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 592, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'mac_address': 'fa:16:3e:cf:29:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:44:10Z', 'updated_at': '2021-05-25T16:44:10Z', 'revision_number': 0, 'project_id': '99ba5095326e4a449eb209304e90545f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dfc3005c-08e6-444a-9b5b-ae177a8dc3e1', 'name': '', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'mac_address': 'fa:16:3e:6d:34:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_interface', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:07Z', 'updated_at': '2021-05-25T16:43:14Z', 'revision_number': 5, 'project_id': '99ba5095326e4a449eb209304e90545f', 'subnets': [{'id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:44:13.583966 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-44160f60-614f-44e9-83e3-cfff9da6faa2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.598718 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-44160f60-614f-44e9-83e3-cfff9da6faa2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.601000 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-7b1374f9-20b2-4088-954f-345b39c7e418 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:13.638294 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44160f60-614f-44e9-83e3-cfff9da6faa2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f24183b0-0a8c-42d3-a430-578274640467,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:13.644396 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-44160f60-614f-44e9-83e3-cfff9da6faa2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:13.655713 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-44160f60-614f-44e9-83e3-cfff9da6faa2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.657432 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-44160f60-614f-44e9-83e3-cfff9da6faa2 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.2620952
May 25 16:44:13.660056 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 59890) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:13.667674 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-c678f658-84fb-4949-89d7-8e611f5994e7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Request body: {'security_group_rule': {'security_group_id': '772f7160-6018-4856-bef5-ffd50932ea20', 'project_id': '99ba5095326e4a449eb209304e90545f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:44:13.681011 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-c678f658-84fb-4949-89d7-8e611f5994e7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:13.688461 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-c678f658-84fb-4949-89d7-8e611f5994e7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Usage tracker for resource:security_group_rule and tenant:99ba5095326e4a449eb209304e90545f is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:13.691963 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-c678f658-84fb-4949-89d7-8e611f5994e7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:13.713507 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-c678f658-84fb-4949-89d7-8e611f5994e7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:13.744968 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.securitygroups_db [None req-c678f658-84fb-4949-89d7-8e611f5994e7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Project 99ba5095326e4a449eb209304e90545f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 25 16:44:13.752426 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c678f658-84fb-4949-89d7-8e611f5994e7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.860291 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca59f311-cafd-4ecd-89ca-6c84905b7457 None None] New status for floating IP 7ca10b76-66b9-4a27-9ad6-a462e20dc32d: ACTIVE {{(pid=92014) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:44:13.888466 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c678f658-84fb-4949-89d7-8e611f5994e7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.926672 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c678f658-84fb-4949-89d7-8e611f5994e7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592212'] for security_group_rule, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.932976 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-b1b6267d-2688-4d21-88f6-df3eef7ef79b tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:13.963145 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c678f658-84fb-4949-89d7-8e611f5994e7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=225e700d-e91a-4057-b0c6-3bb29ba9f7d0,revision_number=0']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:13.970370 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c678f658-84fb-4949-89d7-8e611f5994e7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:13.989935 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c678f658-84fb-4949-89d7-8e611f5994e7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:13.991529 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-c678f658-84fb-4949-89d7-8e611f5994e7 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.3304667
May 25 16:44:14.028862 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d0a4295-ddaf-487d-8e0f-eb8ac2751af1 req-5910495a-fe14-458a-8d93-a8b37fabf832 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:14.048828 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7d0a4295-ddaf-487d-8e0f-eb8ac2751af1 req-5910495a-fe14-458a-8d93-a8b37fabf832 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.1650023
May 25 16:44:14.166026 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7d0a4295-ddaf-487d-8e0f-eb8ac2751af1 req-fc7ac42d-2922-4bbb-a0f0-1b56176faf1a tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.1073997
May 25 16:44:14.171053 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:14.178168 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eb29c24f-5d52-4513-8f76-7012f0e50f98 req-08743b71-d60d-4248-8065-fd160de07c40 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1771185305&fields=id&tenant_id=99ba5095326e4a449eb209304e90545f HTTP/1.1" status: 200  len: 267 time: 0.0803609
May 25 16:44:14.296781 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb29c24f-5d52-4513-8f76-7012f0e50f98 req-e8a67133-ae40-4cba-b727-e3bdefbca7d8 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:14.298747 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eb29c24f-5d52-4513-8f76-7012f0e50f98 req-e8a67133-ae40-4cba-b727-e3bdefbca7d8 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 945 time: 0.1146231
May 25 16:44:14.313150 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-eb29c24f-5d52-4513-8f76-7012f0e50f98 req-12245070-5b3d-42e3-861d-d606f2fa63a0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Request body: {'port': {'security_groups': ['87adbc8b-3d4f-4d64-a49b-750ed4406f55', '772f7160-6018-4856-bef5-ffd50932ea20']}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:44:14.464909 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-eb29c24f-5d52-4513-8f76-7012f0e50f98 req-12245070-5b3d-42e3-861d-d606f2fa63a0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:14.853041 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-eb29c24f-5d52-4513-8f76-7012f0e50f98 req-12245070-5b3d-42e3-861d-d606f2fa63a0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] For port 0266b6be-df05-4348-ad78-3c6b9cb56031, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0266b6be-df05-4348-ad78-3c6b9cb56031,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:44:14.878950 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-eb29c24f-5d52-4513-8f76-7012f0e50f98 req-12245070-5b3d-42e3-861d-d606f2fa63a0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:14.883304 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-eb29c24f-5d52-4513-8f76-7012f0e50f98 req-12245070-5b3d-42e3-861d-d606f2fa63a0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:14.888980 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-cb6e15b3-6f0f-46bc-b55c-9cd4a026241e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:14.957486 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb29c24f-5d52-4513-8f76-7012f0e50f98 req-12245070-5b3d-42e3-861d-d606f2fa63a0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:14.958098 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-eb29c24f-5d52-4513-8f76-7012f0e50f98 req-12245070-5b3d-42e3-861d-d606f2fa63a0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:14.959465 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eb29c24f-5d52-4513-8f76-7012f0e50f98 req-12245070-5b3d-42e3-861d-d606f2fa63a0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "PUT /v2.0/ports/0266b6be-df05-4348-ad78-3c6b9cb56031 HTTP/1.1" status: 200  len: 981 time: 0.6534708
May 25 16:44:14.959997 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:44:14.982250 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12245070-5b3d-42e3-861d-d606f2fa63a0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event updated for resources: {'Port': ['ID=0266b6be-df05-4348-ad78-3c6b9cb56031,revision_number=6']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:14.986644 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-12245070-5b3d-42e3-861d-d606f2fa63a0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:15.048646 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031', 'status': 'completed', 'code': 200}
May 25 16:44:15.175273 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb74a3b-8498-4b21-b3a3-58d2e4a1365b req-a38c5e3b-6015-4812-8264-a2a65951aeb0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:15.176859 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1cb74a3b-8498-4b21-b3a3-58d2e4a1365b req-a38c5e3b-6015-4812-8264-a2a65951aeb0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 984 time: 0.0985250
May 25 16:44:15.196312 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-d5ffb259-5ba2-4b5e-8a63-1ae1cb8fd575 None None] Provisioning complete for port 0266b6be-df05-4348-ad78-3c6b9cb56031 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:44:15.196945 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d5ffb259-5ba2-4b5e-8a63-1ae1cb8fd575 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:15.237456 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1cb74a3b-8498-4b21-b3a3-58d2e4a1365b req-329905f9-6ec4-46db-9a64-4ad7f4eeac32 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&id=772f7160-6018-4856-bef5-ffd50932ea20&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0510669
May 25 16:44:15.417262 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cf51b8b-fca6-4b31-84db-6ac6c070e707 req-d76a6909-46b4-4d42-bbe8-8b4410ab3acc tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:15.418683 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8cf51b8b-fca6-4b31-84db-6ac6c070e707 req-d76a6909-46b4-4d42-bbe8-8b4410ab3acc tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.0805998
May 25 16:44:15.465114 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8cf51b8b-fca6-4b31-84db-6ac6c070e707 req-6dbfccf3-4c43-4583-a598-c3a0fb6643e2 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0408392
May 25 16:44:16.705342 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1b988e5-1476-4945-ae9f-2adf1b88b578 req-6eee745a-e071-4d41-a178-7103c4f27da7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:16.707352 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d1b988e5-1476-4945-ae9f-2adf1b88b578 req-6eee745a-e071-4d41-a178-7103c4f27da7 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.0845830
May 25 16:44:16.760365 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['0266b6be-df05-4348-ad78-3c6b9cb56031'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:44:16.768555 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d1b988e5-1476-4945-ae9f-2adf1b88b578 req-facb9c85-4a99-41ab-a778-e2d2abd08601 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0451388
May 25 16:44:17.935827 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['0266b6be-df05-4348-ad78-3c6b9cb56031'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:44:17.977592 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3000d3c-30fe-4076-b045-38a32f5eb3fc req-c8807e4d-6eff-4ac7-9e36-4dc08c6ff22c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:17.979210 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f3000d3c-30fe-4076-b045-38a32f5eb3fc req-c8807e4d-6eff-4ac7-9e36-4dc08c6ff22c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.0935898
May 25 16:44:18.038325 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f3000d3c-30fe-4076-b045-38a32f5eb3fc req-8779d9f4-1515-4d0d-955f-3aeeb3bbaeeb tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0504344
May 25 16:44:19.254939 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4fe42c-e82d-407b-a957-c6e6ef424b62 req-f57c7205-2d8e-4b26-a7e9-0335019cdad0 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:19.262046 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ba4fe42c-e82d-407b-a957-c6e6ef424b62 req-f57c7205-2d8e-4b26-a7e9-0335019cdad0 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.0973091
May 25 16:44:19.321683 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ba4fe42c-e82d-407b-a957-c6e6ef424b62 req-8fddd442-7d56-4e29-9957-4111ccba34b1 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0567007
May 25 16:44:20.542908 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c08a389-8000-4808-a448-27ee73896233 req-b7945561-68ff-443a-968f-dbe842e69a92 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:20.544539 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c08a389-8000-4808-a448-27ee73896233 req-b7945561-68ff-443a-968f-dbe842e69a92 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.0863123
May 25 16:44:20.593292 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6c08a389-8000-4808-a448-27ee73896233 req-b410dd0c-8c43-4d59-8430-43da7127ca44 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0425451
May 25 16:44:21.588091 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10f79aad-73a1-4b37-924a-2e31a5a95136 req-8b891b25-082d-4317-a9a9-9d0dcd6d6c3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:21.589579 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-10f79aad-73a1-4b37-924a-2e31a5a95136 req-8b891b25-082d-4317-a9a9-9d0dcd6d6c3c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=99ba5095326e4a449eb209304e90545f&device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 1137 time: 0.0702536
May 25 16:44:21.758941 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10f79aad-73a1-4b37-924a-2e31a5a95136 req-88d69b86-84f0-401f-90cd-ab20b3c9806e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:21.760338 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-10f79aad-73a1-4b37-924a-2e31a5a95136 req-88d69b86-84f0-401f-90cd-ab20b3c9806e service neutron] 10.222.0.76 "GET /v2.0/networks?id=b95afcbb-a35f-4e21-a67d-e6712b2de87f HTTP/1.1" status: 200  len: 916 time: 0.1638613
May 25 16:44:21.881284 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-10f79aad-73a1-4b37-924a-2e31a5a95136 req-434c4b2b-f7de-47a9-910f-6751cce07cb2 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0266b6be-df05-4348-ad78-3c6b9cb56031 HTTP/1.1" status: 200  len: 1001 time: 0.1073601
May 25 16:44:21.889436 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92039bb6-3291-43b1-895a-cef30343169c req-f9a90917-2d6a-4f12-89d4-e9169cbe8530 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:21.890811 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92039bb6-3291-43b1-895a-cef30343169c req-f9a90917-2d6a-4f12-89d4-e9169cbe8530 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.1762199
May 25 16:44:21.987487 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-92039bb6-3291-43b1-895a-cef30343169c req-20723cf2-01fe-414b-b3e2-ce340090fa7b tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0640025
May 25 16:44:21.991636 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10f79aad-73a1-4b37-924a-2e31a5a95136 req-7d0d5371-d474-41f5-b826-f077438b98af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:21.993110 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-10f79aad-73a1-4b37-924a-2e31a5a95136 req-7d0d5371-d474-41f5-b826-f077438b98af service neutron] 10.222.0.76 "GET /v2.0/subnets?id=8641bb52-68d1-4215-b71c-1965a76b5e66 HTTP/1.1" status: 200  len: 854 time: 0.1014926
May 25 16:44:22.077746 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10f79aad-73a1-4b37-924a-2e31a5a95136 req-65f0702e-a5cb-4a6a-beb6-21b8e724f8a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:22.079273 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-10f79aad-73a1-4b37-924a-2e31a5a95136 req-65f0702e-a5cb-4a6a-beb6-21b8e724f8a6 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b95afcbb-a35f-4e21-a67d-e6712b2de87f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0764089
May 25 16:44:22.200344 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59978) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:22.214215 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-10f79aad-73a1-4b37-924a-2e31a5a95136 req-cb681b3e-ddcc-40fc-9e87-8c6e0ce68f04 service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1248045
May 25 16:44:22.328473 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5f877f39-e916-46b4-8e91-399fe71e4541 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:22.347288 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-5f877f39-e916-46b4-8e91-399fe71e4541 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:22.349899 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-10f79aad-73a1-4b37-924a-2e31a5a95136 req-9452bc7b-af56-43d4-bc11-ca9bf0aa602d service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1282916
May 25 16:44:22.351112 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-5f877f39-e916-46b4-8e91-399fe71e4541 admin admin] Usage tracker for resource:security_group_rule and tenant:38a7d2746eeb44abaf84aa9491bedb4f is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:22.353959 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-5f877f39-e916-46b4-8e91-399fe71e4541 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:22.359735 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-5f877f39-e916-46b4-8e91-399fe71e4541 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:22.443003 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5f877f39-e916-46b4-8e91-399fe71e4541 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:22.447268 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5f877f39-e916-46b4-8e91-399fe71e4541 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:22.456796 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-601042c0-c69f-4597-80f5-39a169853bd6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:22.466161 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5974bdab-0708-43c2-9f49-869c1131803f req-256bd07a-c984-4c09-ab31-fe4989910faa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:22.467721 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5974bdab-0708-43c2-9f49-869c1131803f req-256bd07a-c984-4c09-ab31-fe4989910faa service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=99ba5095326e4a449eb209304e90545f&device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 1137 time: 0.0712686
May 25 16:44:22.496098 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-5f877f39-e916-46b4-8e91-399fe71e4541 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=38a7d2746eeb44abaf84aa9491bedb4f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2944341
May 25 16:44:22.498011 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f877f39-e916-46b4-8e91-399fe71e4541 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ee5d069d-faa1-47e2-9a09-42295742b00a,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:22.500248 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 59984) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:22.503122 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-5f877f39-e916-46b4-8e91-399fe71e4541 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:22.569552 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f5b2945f-2cc8-4367-9726-dac98b78e861 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:22.596853 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f5b2945f-2cc8-4367-9726-dac98b78e861 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:22.650221 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f5b2945f-2cc8-4367-9726-dac98b78e861 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:22.655334 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-5fd8460d-0b95-4755-b4c4-91d1bd87511f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:22.668428 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5b2945f-2cc8-4367-9726-dac98b78e861 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ee5d069d-faa1-47e2-9a09-42295742b00a,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:22.671287 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f5b2945f-2cc8-4367-9726-dac98b78e861 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:22.677686 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f5b2945f-2cc8-4367-9726-dac98b78e861 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:22.681141 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f5b2945f-2cc8-4367-9726-dac98b78e861 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/ee5d069d-faa1-47e2-9a09-42295742b00a HTTP/1.1" status: 204  len: 168 time: 0.1776679
May 25 16:44:22.689735 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5974bdab-0708-43c2-9f49-869c1131803f req-cbb1cfdc-c251-4731-b419-801a05dab035 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:22.691169 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5974bdab-0708-43c2-9f49-869c1131803f req-cbb1cfdc-c251-4731-b419-801a05dab035 service neutron] 10.222.0.76 "GET /v2.0/networks?id=b95afcbb-a35f-4e21-a67d-e6712b2de87f HTTP/1.1" status: 200  len: 916 time: 0.2164745
May 25 16:44:22.807463 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5974bdab-0708-43c2-9f49-869c1131803f req-b09cf032-2382-4395-9f8e-ee0c395a8a3f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0266b6be-df05-4348-ad78-3c6b9cb56031 HTTP/1.1" status: 200  len: 1001 time: 0.1046431
May 25 16:44:22.874411 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5974bdab-0708-43c2-9f49-869c1131803f req-a62f7e29-8ba6-44e7-af3e-d625b67cc191 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:22.875847 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5974bdab-0708-43c2-9f49-869c1131803f req-a62f7e29-8ba6-44e7-af3e-d625b67cc191 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=8641bb52-68d1-4215-b71c-1965a76b5e66 HTTP/1.1" status: 200  len: 854 time: 0.0598066
May 25 16:44:22.953958 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5974bdab-0708-43c2-9f49-869c1131803f req-5fb97054-d7c8-42c4-89a4-4c59d640ce10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:22.955484 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5974bdab-0708-43c2-9f49-869c1131803f req-5fb97054-d7c8-42c4-89a4-4c59d640ce10 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b95afcbb-a35f-4e21-a67d-e6712b2de87f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0730817
May 25 16:44:23.094250 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5974bdab-0708-43c2-9f49-869c1131803f req-d98557ae-a869-4b63-b00e-6a9a797879e6 service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1312068
May 25 16:44:23.304273 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ccffd1-2cb7-413b-8ac9-9d1a084b7a6c req-6b8e4002-e65a-44f8-b39e-8ad2d2bff69e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:23.305807 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-33ccffd1-2cb7-413b-8ac9-9d1a084b7a6c req-6b8e4002-e65a-44f8-b39e-8ad2d2bff69e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.2026947
May 25 16:44:23.308104 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5974bdab-0708-43c2-9f49-869c1131803f req-0e44cd40-a080-47ac-8151-0472f08077ee service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2061794
May 25 16:44:23.351863 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-33ccffd1-2cb7-413b-8ac9-9d1a084b7a6c req-f011c779-9a21-41f3-9084-c12cf93a8984 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0400474
May 25 16:44:24.031703 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60030) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:24.146912 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f3e1fa86-9709-4e6d-8750-10d3c61afe2d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:24.161319 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f3e1fa86-9709-4e6d-8750-10d3c61afe2d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:24.165062 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f3e1fa86-9709-4e6d-8750-10d3c61afe2d admin admin] Usage tracker for resource:security_group_rule and tenant:068e4d3b3aa7487a9375687e031e4773 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:24.167851 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f3e1fa86-9709-4e6d-8750-10d3c61afe2d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:24.174044 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f3e1fa86-9709-4e6d-8750-10d3c61afe2d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:24.252551 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f3e1fa86-9709-4e6d-8750-10d3c61afe2d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:24.256348 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f3e1fa86-9709-4e6d-8750-10d3c61afe2d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:24.263531 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f1522732-abe3-4892-a831-59e16a2a5f62 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:24.308924 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f3e1fa86-9709-4e6d-8750-10d3c61afe2d admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=068e4d3b3aa7487a9375687e031e4773&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2760658
May 25 16:44:24.311702 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 60036) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:24.315757 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3e1fa86-9709-4e6d-8750-10d3c61afe2d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fb101b1-6a38-4ddf-92ac-281ff91691f8,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:24.319164 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f3e1fa86-9709-4e6d-8750-10d3c61afe2d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:24.370156 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8a45087a-ad67-4e8b-b10c-ba14e4849f1a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:24.396586 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8a45087a-ad67-4e8b-b10c-ba14e4849f1a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:24.449535 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8a45087a-ad67-4e8b-b10c-ba14e4849f1a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:24.453292 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-58c3d329-63ce-498e-85fd-86941a0f6878 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:24.465954 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a45087a-ad67-4e8b-b10c-ba14e4849f1a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fb101b1-6a38-4ddf-92ac-281ff91691f8,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:24.470837 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-8a45087a-ad67-4e8b-b10c-ba14e4849f1a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:24.510186 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-8a45087a-ad67-4e8b-b10c-ba14e4849f1a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:24.511274 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-8a45087a-ad67-4e8b-b10c-ba14e4849f1a admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/2fb101b1-6a38-4ddf-92ac-281ff91691f8 HTTP/1.1" status: 204  len: 168 time: 0.1986229
May 25 16:44:24.556128 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a5e82c3-2e6b-49ff-b436-31f532df9a7a req-32413ee1-a63c-4aad-bb1b-2c7da5e8a358 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:24.557953 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6a5e82c3-2e6b-49ff-b436-31f532df9a7a req-32413ee1-a63c-4aad-bb1b-2c7da5e8a358 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 943 time: 0.0934644
May 25 16:44:24.604790 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6a5e82c3-2e6b-49ff-b436-31f532df9a7a req-db6e7b83-cdc8-43c4-a08e-bb6b0bf2074d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0413063
May 25 16:44:24.780637 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 5c47c017-af78-4c20-a79c-f54715856946 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:44:24.919691 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 5c47c017-af78-4c20-a79c-f54715856946, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=5c47c017-af78-4c20-a79c-f54715856946,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:44:24.934323 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '5c47c017-af78-4c20-a79c-f54715856946', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'port_id': '5c47c017-af78-4c20-a79c-f54715856946', 'mac_address': 'fa:16:3e:0b:6e:97', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 414, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:44:24.998256 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:25.015804 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5c47c017-af78-4c20-a79c-f54715856946 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:44:25.032085 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 5c47c017-af78-4c20-a79c-f54715856946, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=5c47c017-af78-4c20-a79c-f54715856946,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:44:25.036362 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:25.038171 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:25.104402 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=5c47c017-af78-4c20-a79c-f54715856946,revision_number=9']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:25.110222 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:25.347821 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['5c47c017-af78-4c20-a79c-f54715856946'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:44:25.824969 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b65a40b2-b81c-4386-907f-be572c93d42a req-5a6b522a-ac6c-48a2-9ac3-09d54f549197 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:25.826803 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b65a40b2-b81c-4386-907f-be572c93d42a req-5a6b522a-ac6c-48a2-9ac3-09d54f549197 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 944 time: 0.0895648
May 25 16:44:25.878723 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b65a40b2-b81c-4386-907f-be572c93d42a req-a8a4b7c4-70ab-4aea-ac45-0d2b544b757c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0454390
May 25 16:44:26.794239 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 5c47c017-af78-4c20-a79c-f54715856946 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:44:26.862249 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 5c47c017-af78-4c20-a79c-f54715856946 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:44:26.862699 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:26.982861 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:27.011494 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c47c017-af78-4c20-a79c-f54715856946'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:44:27.022574 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 5c47c017-af78-4c20-a79c-f54715856946, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=5c47c017-af78-4c20-a79c-f54715856946,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:44:27.039726 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:27.042821 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:27.091798 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcf2deb8-7aed-4fad-a7fe-3f7d382eec07 req-3aee26de-2546-48b2-9272-ee606a6adf30 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:27.093918 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bcf2deb8-7aed-4fad-a7fe-3f7d382eec07 req-3aee26de-2546-48b2-9272-ee606a6adf30 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 946 time: 0.1018379
May 25 16:44:27.102466 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c47c017-af78-4c20-a79c-f54715856946', 'code': 200}
May 25 16:44:27.149227 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bcf2deb8-7aed-4fad-a7fe-3f7d382eec07 req-65076867-72bb-4c24-b4f5-9373d87d52ab tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0484600
May 25 16:44:27.152997 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=5c47c017-af78-4c20-a79c-f54715856946,revision_number=10']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:27.156503 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:27.336874 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8b75298-380b-4c0e-a8a5-bcd3ce0c26f7 req-2aabbf1f-d4f4-4a75-9324-5961914ee410 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:27.339260 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b8b75298-380b-4c0e-a8a5-bcd3ce0c26f7 req-2aabbf1f-d4f4-4a75-9324-5961914ee410 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 1099 time: 0.0826008
May 25 16:44:27.392867 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b8b75298-380b-4c0e-a8a5-bcd3ce0c26f7 req-776f5846-b5fa-42f7-be48-bd5090d709d5 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0472102
May 25 16:44:28.344931 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ace7db3-375d-482c-bda0-66e8afbcf490 req-ee7c2fc0-0409-455d-8504-24dcb0d5d318 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:28.346385 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7ace7db3-375d-482c-bda0-66e8afbcf490 req-ee7c2fc0-0409-455d-8504-24dcb0d5d318 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 946 time: 0.0817606
May 25 16:44:28.391800 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7ace7db3-375d-482c-bda0-66e8afbcf490 req-11225350-4176-4e48-8295-9ad8bc7a2642 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0396581
May 25 16:44:29.586141 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e2e6238-b0c7-4f53-a22f-30428a9c1db9 req-eb86999e-ce23-4a4c-9857-9e945cff46ac tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:29.587581 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6e2e6238-b0c7-4f53-a22f-30428a9c1db9 req-eb86999e-ce23-4a4c-9857-9e945cff46ac tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 946 time: 0.0832140
May 25 16:44:29.631590 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6e2e6238-b0c7-4f53-a22f-30428a9c1db9 req-4ae19618-57eb-4a0d-bbed-5fc2ce434e3d tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0384023
May 25 16:44:31.424357 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7e4fb499-f18a-4740-bffc-c310e82c987d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:32.663820 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58e7213-846e-48ab-baa3-ab83bc45a440 req-d140491d-a196-417f-82a9-b114706e63ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:32.665278 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f58e7213-846e-48ab-baa3-ab83bc45a440 req-d140491d-a196-417f-82a9-b114706e63ef service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=99ba5095326e4a449eb209304e90545f&device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 1137 time: 0.1412804
May 25 16:44:32.675263 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9e222f5-16dc-4115-ba4d-7afdc4c7e795 req-fa7b233d-f0b3-4999-880a-22a033c64654 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:32.676618 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a9e222f5-16dc-4115-ba4d-7afdc4c7e795 req-fa7b233d-f0b3-4999-880a-22a033c64654 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 984 time: 0.1213210
May 25 16:44:32.890712 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a9e222f5-16dc-4115-ba4d-7afdc4c7e795 req-71c0af50-7886-4f6b-8d9d-7739fa4ad9f3 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&id=772f7160-6018-4856-bef5-ffd50932ea20&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1927650
May 25 16:44:32.927946 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58e7213-846e-48ab-baa3-ab83bc45a440 req-f5bd53b9-9efb-4f2f-9bf2-b809af5e05b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:32.929468 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f58e7213-846e-48ab-baa3-ab83bc45a440 req-f5bd53b9-9efb-4f2f-9bf2-b809af5e05b1 service neutron] 10.222.0.76 "GET /v2.0/networks?id=b95afcbb-a35f-4e21-a67d-e6712b2de87f HTTP/1.1" status: 200  len: 916 time: 0.2519736
May 25 16:44:33.038402 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f58e7213-846e-48ab-baa3-ab83bc45a440 req-5d61bb0d-79c1-4841-97d3-a1bf1bbc8898 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0266b6be-df05-4348-ad78-3c6b9cb56031 HTTP/1.1" status: 200  len: 1001 time: 0.0959539
May 25 16:44:33.102842 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58e7213-846e-48ab-baa3-ab83bc45a440 req-6fdb1bd8-7d39-4014-ba12-c179b1a207ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:33.104212 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f58e7213-846e-48ab-baa3-ab83bc45a440 req-6fdb1bd8-7d39-4014-ba12-c179b1a207ea service neutron] 10.222.0.76 "GET /v2.0/subnets?id=8641bb52-68d1-4215-b71c-1965a76b5e66 HTTP/1.1" status: 200  len: 854 time: 0.0591598
May 25 16:44:33.179252 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58e7213-846e-48ab-baa3-ab83bc45a440 req-3547eada-ab5e-45f6-a0ae-a6abe48fbc75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:33.180583 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f58e7213-846e-48ab-baa3-ab83bc45a440 req-3547eada-ab5e-45f6-a0ae-a6abe48fbc75 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b95afcbb-a35f-4e21-a67d-e6712b2de87f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0686440
May 25 16:44:33.312188 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f58e7213-846e-48ab-baa3-ab83bc45a440 req-ee2685c8-a8fd-44a0-ac80-000117329e7a service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1239467
May 25 16:44:33.444721 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f58e7213-846e-48ab-baa3-ab83bc45a440 req-a16cc751-b638-443c-bef9-031cb78940b6 service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1253815
May 25 16:44:33.836201 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:34.080212 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a86a0c8c-b155-4d3a-8d0b-f10c8aff9768 req-6be2eedd-850c-4f07-ae8a-3a1c81ec5339 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:34.081815 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a86a0c8c-b155-4d3a-8d0b-f10c8aff9768 req-6be2eedd-850c-4f07-ae8a-3a1c81ec5339 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 984 time: 0.0799954
May 25 16:44:34.112101 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-3543c87f-8fe8-47a2-a755-96790b83e173 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:34.133116 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a86a0c8c-b155-4d3a-8d0b-f10c8aff9768 req-1bc52f54-9c90-4e6a-8ba0-6646651698bb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&id=772f7160-6018-4856-bef5-ffd50932ea20&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0452163
May 25 16:44:35.064559 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:35.326210 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2f7b644-418c-4c01-9791-bd528e9174d4 req-8551aae4-785f-45a8-bfa9-596519461076 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:35.327588 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c2f7b644-418c-4c01-9791-bd528e9174d4 req-8551aae4-785f-45a8-bfa9-596519461076 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 984 time: 0.0814924
May 25 16:44:35.380433 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c2f7b644-418c-4c01-9791-bd528e9174d4 req-7c1b9735-a3c4-4124-bab9-2eabee5ef5d0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&id=772f7160-6018-4856-bef5-ffd50932ea20&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0456588
May 25 16:44:35.628072 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:44:36.508530 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60238) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:36.576309 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00c7e25-5766-4049-91eb-1b66610fa308 req-745c8e75-df2f-433a-9c98-3ac2e5884bfc tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:36.578449 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e00c7e25-5766-4049-91eb-1b66610fa308 req-745c8e75-df2f-433a-9c98-3ac2e5884bfc tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 984 time: 0.0938983
May 25 16:44:36.584093 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:36.627977 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e00c7e25-5766-4049-91eb-1b66610fa308 req-49c37eec-5add-49b0-a8fd-da306dc6ba6f tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&id=772f7160-6018-4856-bef5-ffd50932ea20&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0431492
May 25 16:44:36.639018 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1685b0d1-f44e-4a2f-b57f-18e597ca8769 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:36.653575 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-1685b0d1-f44e-4a2f-b57f-18e597ca8769 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:36.657297 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-1685b0d1-f44e-4a2f-b57f-18e597ca8769 admin admin] Usage tracker for resource:security_group_rule and tenant:85e7ea1f65f443ca9f6d6beb4bc62655 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:36.660622 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-1685b0d1-f44e-4a2f-b57f-18e597ca8769 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:36.666443 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-1685b0d1-f44e-4a2f-b57f-18e597ca8769 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:36.746959 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1685b0d1-f44e-4a2f-b57f-18e597ca8769 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:36.750786 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-1685b0d1-f44e-4a2f-b57f-18e597ca8769 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:36.763682 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-e069ef7d-919b-46a7-90b6-c5cbc1e4af8c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:36.802520 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-1685b0d1-f44e-4a2f-b57f-18e597ca8769 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=85e7ea1f65f443ca9f6d6beb4bc62655&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2924471
May 25 16:44:36.803424 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1685b0d1-f44e-4a2f-b57f-18e597ca8769 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f5546c3-93d4-4661-a942-42a1a4258d52,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:36.805240 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 60244) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:36.806549 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-1685b0d1-f44e-4a2f-b57f-18e597ca8769 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:36.863467 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e08a491f-aee4-4918-95eb-1c14ae52d4af admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:36.889906 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e08a491f-aee4-4918-95eb-1c14ae52d4af admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:36.941327 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e08a491f-aee4-4918-95eb-1c14ae52d4af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:36.944924 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-8edee792-8443-46cd-a4b1-c17cbea29195 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:36.956320 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e08a491f-aee4-4918-95eb-1c14ae52d4af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f5546c3-93d4-4661-a942-42a1a4258d52,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:36.960674 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-e08a491f-aee4-4918-95eb-1c14ae52d4af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:36.962603 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-e08a491f-aee4-4918-95eb-1c14ae52d4af admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:36.963688 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-e08a491f-aee4-4918-95eb-1c14ae52d4af admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/6f5546c3-93d4-4661-a942-42a1a4258d52 HTTP/1.1" status: 204  len: 168 time: 0.1574574
May 25 16:44:37.624496 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 60268) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:37.732038 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1586626006-network', 'tenant_id': 'a08b794404294bb48dc9c4982f9bfecb'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:44:37.769589 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:37.777782 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Usage tracker for resource:network and tenant:a08b794404294bb48dc9c4982f9bfecb is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:37.785572 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:37.792785 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:37.810859 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Made reservation on behalf of a08b794404294bb48dc9c4982f9bfecb for: {'network': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:44:37.813181 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-576512'] for network, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:37.833319 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:37.859008 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:37.869912 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82997fae-4427-435e-95e9-63b94316d463 req-605922df-9f4f-4226-a76c-29e3adbea45e tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:37.871355 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-82997fae-4427-435e-95e9-63b94316d463 req-605922df-9f4f-4226-a76c-29e3adbea45e tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 984 time: 0.1359155
May 25 16:44:37.872282 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Usage tracker for resource:security_group_rule and tenant:a08b794404294bb48dc9c4982f9bfecb is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:37.875275 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:37.882108 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:37.939485 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-82997fae-4427-435e-95e9-63b94316d463 req-04e95bd1-3138-44c3-a2c7-353a9891f02e tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&id=772f7160-6018-4856-bef5-ffd50932ea20&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0612698
May 25 16:44:38.001577 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:38.006866 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:38.010017 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-13cbd0ae-b819-42f6-a479-50585b5ef0bf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:38.041267 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 419}  {{(pid=92013) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 16:44:38.046600 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=db9a1bae-fa34-4626-99d1-de81270c9f93,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:38.050416 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:38.054642 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:38.054642 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.segments_db [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Added segment 24e045d0-637a-4a9d-af18-175fe9d4147a of type vlan for network b737aee3-c586-4315-91bd-90bf18067410
May 25 16:44:38.084471 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8741446037333'] for network, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:38.112335 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847'] for network, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:38.113645 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:38.114211 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:38.118735 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:38.211581 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] 10.222.0.73 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 0.5860023
May 25 16:44:38.214459 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Pushing event updated for resources: {'Network': ['ID=b737aee3-c586-4315-91bd-90bf18067410,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:38.214588 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60276) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:38.217111 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:38.220982 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Request body: {'subnet': {'network_id': 'b737aee3-c586-4315-91bd-90bf18067410', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1586626006-subnet', 'tenant_id': 'a08b794404294bb48dc9c4982f9bfecb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:44:38.224408 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Network b737aee3-c586-4315-91bd-90bf18067410 details requested by agent ovs-agent-dv-cinder-786386-6-iscsi with host dv-cinder-786386-6-iscsi {{(pid=92014) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 16:44:38.226165 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:38.230102 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Usage tracker for resource:subnet and tenant:a08b794404294bb48dc9c4982f9bfecb is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:38.233634 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:38.240337 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:38.249311 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Made reservation on behalf of a08b794404294bb48dc9c4982f9bfecb for: {'subnet': 1} {{(pid=92012) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:44:38.252313 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-697612'] for subnet, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:38.634782 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7721570', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-697626'] for subnet, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:38.639315 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:38.707558 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=01b9c44a-4fab-499e-be63-34da3c8d98f4,revision_number=0']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:38.710307 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:38.717287 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Checking segment: {'id': '24e045d0-637a-4a9d-af18-175fe9d4147a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'b737aee3-c586-4315-91bd-90bf18067410'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92012) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:44:38.717671 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Network hostable DHCP agents. Network: b737aee3-c586-4315-91bd-90bf18067410, hostable agents: ['caff21cf-2948-4e7a-9892-65f43e1839b7'], hosted agents: [] {{(pid=92012) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 16:44:38.736500 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Network b737aee3-c586-4315-91bd-90bf18067410 is scheduled to be hosted by DHCP agent caff21cf-2948-4e7a-9892-65f43e1839b7 with binding_index 1 {{(pid=92012) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 16:44:38.745228 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-786386-6-iscsi, b737aee3-c586-4315-91bd-90bf18067410) {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:44:38.754236 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:38.754984 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:38.755845 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-527342a4-22bb-45f8-afec-ed5577015bcb None None] Network b737aee3-c586-4315-91bd-90bf18067410 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:44:38.783160 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f5b95812-0b00-4f9d-a1ca-f537e01ae2b5 admin admin] 10.222.0.73 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 0.5675900
May 25 16:44:38.949970 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81448467-789e-4b27-b7c1-ec2d8b007359 None None] Network b737aee3-c586-4315-91bd-90bf18067410 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:44:39.136362 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b3c8d53-adc6-49d1-bd99-d7843718090a req-c8deaec8-a982-4a64-9118-de590fd4b7c3 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:39.138538 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b3c8d53-adc6-49d1-bd99-d7843718090a req-c8deaec8-a982-4a64-9118-de590fd4b7c3 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 984 time: 0.0905292
May 25 16:44:39.188161 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0b3c8d53-adc6-49d1-bd99-d7843718090a req-63e0969a-c25f-41f5-a083-437d74aec1ac tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&id=772f7160-6018-4856-bef5-ffd50932ea20&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0439248
May 25 16:44:40.371892 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a47706dc-272a-44e0-b0fe-3fcfc52c0a2a req-e13a7a66-07e2-4eb5-b940-aad343b7bd54 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:40.373325 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a47706dc-272a-44e0-b0fe-3fcfc52c0a2a req-e13a7a66-07e2-4eb5-b940-aad343b7bd54 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 984 time: 0.0803988
May 25 16:44:40.422703 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a47706dc-272a-44e0-b0fe-3fcfc52c0a2a req-a0b559dd-64f7-402b-aca0-6d1734eb5e6f tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&id=772f7160-6018-4856-bef5-ffd50932ea20&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0435927
May 25 16:44:40.879381 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b621689a-4873-4340-9337-37a3855141cd req-a3505b45-e087-499a-994b-808f4c25a372 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:40.880046 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-b621689a-4873-4340-9337-37a3855141cd req-a3505b45-e087-499a-994b-808f4c25a372 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Synchronizing usage tracker for tenant:a08b794404294bb48dc9c4982f9bfecb on resource:network {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:44:40.897378 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-b621689a-4873-4340-9337-37a3855141cd req-a3505b45-e087-499a-994b-808f4c25a372 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Unset dirty status for tenant:a08b794404294bb48dc9c4982f9bfecb on resource:network {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:44:40.898522 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-a3505b45-e087-499a-994b-808f4c25a372 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/networks?id=b737aee3-c586-4315-91bd-90bf18067410 HTTP/1.1" status: 200  len: 814 time: 0.2442803
May 25 16:44:40.913257 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-db2b7e65-93a9-4bd4-8523-d562e6fba97f tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/quotas/a08b794404294bb48dc9c4982f9bfecb HTTP/1.1" status: 200  len: 375 time: 0.0094137
May 25 16:44:40.960556 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-7ce952e7-df70-4de6-950c-337599417d70 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=a08b794404294bb48dc9c4982f9bfecb&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0423236
May 25 16:44:41.138751 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-9362c31f-1a71-47e3-8995-3ad351123ea1 service neutron] 10.222.0.73 "GET /v2.0/networks/b737aee3-c586-4315-91bd-90bf18067410?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1713746
May 25 16:44:41.284449 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-54b34474-eeb7-43fe-8bd7-b5de4d158672 service neutron] 10.222.0.73 "GET /v2.0/networks/b737aee3-c586-4315-91bd-90bf18067410?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1391542
May 25 16:44:41.461313 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c10129bf-8aa3-44a9-8921-d166abc562f5 req-96f47b7a-47dd-42c7-91dd-bd6a3c9633c4 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 210 time: 0.0440617
May 25 16:44:41.630725 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93510b97-e655-455b-864b-e9adf9ace7e4 req-2ab19452-6ab3-4f7e-8780-ee1af92e50e1 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:41.632486 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-93510b97-e655-455b-864b-e9adf9ace7e4 req-2ab19452-6ab3-4f7e-8780-ee1af92e50e1 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 984 time: 0.0885174
May 25 16:44:41.683209 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-93510b97-e655-455b-864b-e9adf9ace7e4 req-0297891e-43ba-4a6f-ba04-38371ca73139 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&id=772f7160-6018-4856-bef5-ffd50932ea20&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0440598
May 25 16:44:42.549033 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b621689a-4873-4340-9337-37a3855141cd req-4cf77472-ad21-47dd-9a43-0c94e8ed7c80 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:42.550575 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-4cf77472-ad21-47dd-9a43-0c94e8ed7c80 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.76 "GET /v2.0/networks?id=b737aee3-c586-4315-91bd-90bf18067410 HTTP/1.1" status: 200  len: 814 time: 0.1510725
May 25 16:44:42.570672 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Request body: {'port': {'device_id': '8014a243-8f63-40f1-95b7-9200f8a73636', 'network_id': 'b737aee3-c586-4315-91bd-90bf18067410', 'admin_state_up': True, 'tenant_id': 'a08b794404294bb48dc9c4982f9bfecb'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:44:42.744975 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-19da017b-edd6-4368-b1f9-1f9d788e2297 req-ae2de38e-ba84-4345-ae1e-f34bc33bf616 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 210 time: 0.0997560
May 25 16:44:42.853840 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:44:42.862718 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Usage tracker for resource:port and tenant:a08b794404294bb48dc9c4982f9bfecb is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:44:42.868182 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d62339f-22ba-44c4-9dee-bf9d51e017f4 req-5c266012-05fa-4eb8-af94-3462b6619668 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.2242177
May 25 16:44:42.873777 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:44:42.884016 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:44:42.902724 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Made reservation on behalf of a08b794404294bb48dc9c4982f9bfecb for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:44:42.906246 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:42.978879 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199b8212-8d67-43ae-b917-f87efafc7a3a req-b14d6963-f76e-478a-b033-7dc27fea1aea tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:42.980364 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-199b8212-8d67-43ae-b917-f87efafc7a3a req-b14d6963-f76e-478a-b033-7dc27fea1aea tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 984 time: 0.1797073
May 25 16:44:43.101585 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-199b8212-8d67-43ae-b917-f87efafc7a3a req-813ffdc9-20ab-4870-8218-38660901893a tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&id=772f7160-6018-4856-bef5-ffd50932ea20&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0875604
May 25 16:44:43.178562 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d62339f-22ba-44c4-9dee-bf9d51e017f4 req-6add9f20-d323-41ad-8ee1-433bf56d3b45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:43.180017 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d62339f-22ba-44c4-9dee-bf9d51e017f4 req-6add9f20-d323-41ad-8ee1-433bf56d3b45 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a723bbfba23f463dbb8da0bdacb4b0aa&device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 1098 time: 0.1988029
May 25 16:44:43.185657 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Allocated IP 172.20.0.10 (b737aee3-c586-4315-91bd-90bf18067410/01b9c44a-4fab-499e-be63-34da3c8d98f4/cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:44:43.491353 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d62339f-22ba-44c4-9dee-bf9d51e017f4 req-66769479-977c-4320-84a0-6055969393bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:43.492776 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d62339f-22ba-44c4-9dee-bf9d51e017f4 req-66769479-977c-4320-84a0-6055969393bd service neutron] 10.222.0.76 "GET /v2.0/networks?id=3e40698a-e2cb-4812-9711-e3b481dbc8b3 HTTP/1.1" status: 200  len: 910 time: 0.2816906
May 25 16:44:43.745594 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:43.749665 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d62339f-22ba-44c4-9dee-bf9d51e017f4 req-889412d8-d119-4de6-8702-ccddb4830ce7 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba HTTP/1.1" status: 200  len: 1001 time: 0.2462020
May 25 16:44:43.826779 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d62339f-22ba-44c4-9dee-bf9d51e017f4 req-9c95b2a9-5ac8-44e4-919d-d3f7c17dae67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:43.828210 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d62339f-22ba-44c4-9dee-bf9d51e017f4 req-9c95b2a9-5ac8-44e4-919d-d3f7c17dae67 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=6203ecab-ef7b-4872-ac7a-33ea4cfae323 HTTP/1.1" status: 200  len: 848 time: 0.0673053
May 25 16:44:43.834520 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:43.868834 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:43.989217 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Network b737aee3-c586-4315-91bd-90bf18067410 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:44:44.001445 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:44:44.014258 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:44:44.049319 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Pushing event updated for resources: {'Port': ['ID=cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:44.058219 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:44.105004 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:44.105629 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:44.120420 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d62339f-22ba-44c4-9dee-bf9d51e017f4 req-498cf797-46ea-4adb-97d4-01e6e57f6df3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:44.121892 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d62339f-22ba-44c4-9dee-bf9d51e017f4 req-498cf797-46ea-4adb-97d4-01e6e57f6df3 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=3e40698a-e2cb-4812-9711-e3b481dbc8b3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2855685
May 25 16:44:44.132557 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3cfcf48-2fad-45b7-b41a-1ca2689c0c21 req-1ded5655-bd5e-4e2b-8e43-26f3fdacc7db tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:44.133653 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d3cfcf48-2fad-45b7-b41a-1ca2689c0c21 req-1ded5655-bd5e-4e2b-8e43-26f3fdacc7db tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 932 time: 0.2346735
May 25 16:44:44.143338 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:44.224193 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.6578891
May 25 16:44:44.291461 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Request body: {'port': {'device_id': '8014a243-8f63-40f1-95b7-9200f8a73636', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:44:44.375516 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-d3cfcf48-2fad-45b7-b41a-1ca2689c0c21 req-2fb71745-0a4c-4983-8a8f-10d6cec79b59 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Synchronizing usage tracker for tenant:a08b794404294bb48dc9c4982f9bfecb on resource:security_group {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:44:44.458051 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d62339f-22ba-44c4-9dee-bf9d51e017f4 req-7089da58-09d3-4fb6-af8b-d80e9b67a8af service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3195012
May 25 16:44:44.474189 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-d3cfcf48-2fad-45b7-b41a-1ca2689c0c21 req-2fb71745-0a4c-4983-8a8f-10d6cec79b59 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Unset dirty status for tenant:a08b794404294bb48dc9c4982f9bfecb on resource:security_group {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:44:44.475237 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d3cfcf48-2fad-45b7-b41a-1ca2689c0c21 req-2fb71745-0a4c-4983-8a8f-10d6cec79b59 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3172162
May 25 16:44:44.570786 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc004cde-60df-4966-8e60-63a2b58cf6de req-ab144af7-1a31-44b6-98e3-8b037e5f11ac tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:44.572254 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cc004cde-60df-4966-8e60-63a2b58cf6de req-ab144af7-1a31-44b6-98e3-8b037e5f11ac tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 984 time: 0.3472168
May 25 16:44:44.579302 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:44.712194 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cc004cde-60df-4966-8e60-63a2b58cf6de req-6c1a1e20-d8f2-4579-907f-29bf06d9d2a6 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&id=772f7160-6018-4856-bef5-ffd50932ea20&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1207387
May 25 16:44:44.728884 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d62339f-22ba-44c4-9dee-bf9d51e017f4 req-b3d4d6cb-f97d-421d-b83b-dc68933641f1 service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2567539
May 25 16:44:44.997470 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:44:45.004630 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:45.023816 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Transition to ACTIVE for port object cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:44:45.027801 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:45.032673 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:45.211554 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Pushing event updated for resources: {'Port': ['ID=cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:45.216425 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:45.255316 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Attempting to bind port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:44:45.255576 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Attempting to bind port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '24e045d0-637a-4a9d-af18-175fe9d4147a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'b737aee3-c586-4315-91bd-90bf18067410'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:44:45.255897 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Attempting to bind port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d on network b737aee3-c586-4315-91bd-90bf18067410 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:44:45.260361 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d on network b737aee3-c586-4315-91bd-90bf18067410 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:44:45.260673 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Attempting to bind port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d on network b737aee3-c586-4315-91bd-90bf18067410 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:44:45.265672 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 44, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:44:45.266004 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Checking segment: {'id': '24e045d0-637a-4a9d-af18-175fe9d4147a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'b737aee3-c586-4315-91bd-90bf18067410'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:44:45.266384 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Bound using segment: {'id': '24e045d0-637a-4a9d-af18-175fe9d4147a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'b737aee3-c586-4315-91bd-90bf18067410'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:44:45.267314 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Bound port: cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '24e045d0-637a-4a9d-af18-175fe9d4147a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'b737aee3-c586-4315-91bd-90bf18067410'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:44:45.267651 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:45.457105 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] For port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:44:45.460331 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] For port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d,segment=NetworkSegment(24e045d0-637a-4a9d-af18-175fe9d4147a),segment_id=24e045d0-637a-4a9d-af18-175fe9d4147a)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:44:45.463731 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:45.467296 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-89584d19-94a6-4ffd-8a36-b4c12fc651ea tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:45.526696 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:45.527304 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:45.528648 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] 10.222.0.76 "PUT /v2.0/ports/cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d HTTP/1.1" status: 200  len: 1094 time: 1.2515569
May 25 16:44:45.529140 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8014a243-8f63-40f1-95b7-9200f8a73636', 'tag': 'cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:44:45.549036 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Pushing event updated for resources: {'Port': ['ID=cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:45.552625 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:45.628319 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8014a243-8f63-40f1-95b7-9200f8a73636', 'tag': 'cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d', 'status': 'completed', 'code': 200}
May 25 16:44:45.730280 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b621689a-4873-4340-9337-37a3855141cd req-f60c8885-16db-49b8-b77d-f801d02900f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:45.731818 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-f60c8885-16db-49b8-b77d-f801d02900f0 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a08b794404294bb48dc9c4982f9bfecb&device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 1097 time: 0.1363308
May 25 16:44:45.741730 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dffd3503-a777-4e83-ba30-0a0f9d2b37cb req-adfb927e-018c-4b8d-9dd4-d8ec37b1b8f2 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:45.742423 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-dffd3503-a777-4e83-ba30-0a0f9d2b37cb req-adfb927e-018c-4b8d-9dd4-d8ec37b1b8f2 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Synchronizing usage tracker for tenant:a08b794404294bb48dc9c4982f9bfecb on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:44:45.809137 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-70f72a41-4403-47fa-83ca-df6696380ebd service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d HTTP/1.1" status: 200  len: 217 time: 0.0637884
May 25 16:44:45.855000 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-dffd3503-a777-4e83-ba30-0a0f9d2b37cb req-adfb927e-018c-4b8d-9dd4-d8ec37b1b8f2 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Unset dirty status for tenant:a08b794404294bb48dc9c4982f9bfecb on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:44:45.856088 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dffd3503-a777-4e83-ba30-0a0f9d2b37cb req-adfb927e-018c-4b8d-9dd4-d8ec37b1b8f2 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 944 time: 0.2270195
May 25 16:44:45.959441 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b621689a-4873-4340-9337-37a3855141cd req-71f19fed-5a26-4bd7-8fa3-df6898ae8bf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:45.960896 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-71f19fed-5a26-4bd7-8fa3-df6898ae8bf2 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=01b9c44a-4fab-499e-be63-34da3c8d98f4 HTTP/1.1" status: 200  len: 854 time: 0.1430678
May 25 16:44:45.970440 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dffd3503-a777-4e83-ba30-0a0f9d2b37cb req-635257b4-e700-4e6b-89cd-ef10b7123d03 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0812464
May 25 16:44:46.028492 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-c90cb436-1046-4207-b9a6-c787c3f55d6e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b737aee3-c586-4315-91bd-90bf18067410&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0488379
May 25 16:44:46.037022 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7de60e5b-ed23-4af8-affe-19d3a88b8403 req-dc189de0-0531-46aa-9e95-cd5f60ff31a3 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:46.038451 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7de60e5b-ed23-4af8-affe-19d3a88b8403 req-dc189de0-0531-46aa-9e95-cd5f60ff31a3 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 984 time: 0.1879559
May 25 16:44:46.165066 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7de60e5b-ed23-4af8-affe-19d3a88b8403 req-3e34802e-fb7b-41bf-b9d7-c09e11e064fc tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&id=772f7160-6018-4856-bef5-ffd50932ea20&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1053071
May 25 16:44:46.202643 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-87284dfb-0b30-498a-83c8-c838e8237869 service neutron] 10.222.0.76 "GET /v2.0/networks/b737aee3-c586-4315-91bd-90bf18067410?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1607566
May 25 16:44:46.333898 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b621689a-4873-4340-9337-37a3855141cd req-ff5a6fd1-37dd-4090-903b-60fe9c1125f1 service neutron] 10.222.0.76 "GET /v2.0/networks/b737aee3-c586-4315-91bd-90bf18067410?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1230264
May 25 16:44:46.453234 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48eb778-d561-493f-a5c0-c988a35e68cf req-8a7ff358-7828-4fbd-bce9-7d0f55c07812 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:46.454675 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b48eb778-d561-493f-a5c0-c988a35e68cf req-8a7ff358-7828-4fbd-bce9-7d0f55c07812 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a08b794404294bb48dc9c4982f9bfecb&device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 1097 time: 0.0740385
May 25 16:44:46.587445 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48eb778-d561-493f-a5c0-c988a35e68cf req-83b70598-ce6b-4544-a883-e43a346107a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:46.588868 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b48eb778-d561-493f-a5c0-c988a35e68cf req-83b70598-ce6b-4544-a883-e43a346107a2 service neutron] 10.222.0.76 "GET /v2.0/networks?id=b737aee3-c586-4315-91bd-90bf18067410 HTTP/1.1" status: 200  len: 915 time: 0.1268475
May 25 16:44:46.662504 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b48eb778-d561-493f-a5c0-c988a35e68cf req-c7dc19e5-c2f4-4837-af9f-0feb8d5aecb7 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d HTTP/1.1" status: 200  len: 217 time: 0.0664423
May 25 16:44:46.730378 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48eb778-d561-493f-a5c0-c988a35e68cf req-99da7053-b164-4a98-9285-82a70e33796d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:46.731960 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b48eb778-d561-493f-a5c0-c988a35e68cf req-99da7053-b164-4a98-9285-82a70e33796d service neutron] 10.222.0.76 "GET /v2.0/subnets?id=01b9c44a-4fab-499e-be63-34da3c8d98f4 HTTP/1.1" status: 200  len: 854 time: 0.0617940
May 25 16:44:46.777948 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b48eb778-d561-493f-a5c0-c988a35e68cf req-bcec9a4c-0038-4d34-806c-f5d553be9f5b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b737aee3-c586-4315-91bd-90bf18067410&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0390186
May 25 16:44:46.906579 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b48eb778-d561-493f-a5c0-c988a35e68cf req-ed3a9ee8-2b52-4b6b-9127-f625f6d5f3ed service neutron] 10.222.0.76 "GET /v2.0/networks/b737aee3-c586-4315-91bd-90bf18067410?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1211674
May 25 16:44:47.183874 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b48eb778-d561-493f-a5c0-c988a35e68cf req-9d76d424-be0e-4c02-ad8d-ca0ae666ade2 service neutron] 10.222.0.76 "GET /v2.0/networks/b737aee3-c586-4315-91bd-90bf18067410?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2663832
May 25 16:44:47.199421 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dce38ef5-db8e-46fc-8d1e-fc0e66529aff req-a0f09c3f-dc8c-4373-99a7-7944426049a1 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:47.200830 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dce38ef5-db8e-46fc-8d1e-fc0e66529aff req-a0f09c3f-dc8c-4373-99a7-7944426049a1 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 944 time: 0.1162703
May 25 16:44:47.244876 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dce38ef5-db8e-46fc-8d1e-fc0e66529aff req-e2d72e5f-d3f5-4a4b-9e63-5150c828e30f tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377264
May 25 16:44:48.425589 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e77804c-d038-4e15-98c1-8e9d446429d7 req-a53f91a3-4ff7-444d-82af-5a14b6968b15 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:48.427009 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1e77804c-d038-4e15-98c1-8e9d446429d7 req-a53f91a3-4ff7-444d-82af-5a14b6968b15 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 944 time: 0.0779316
May 25 16:44:48.471679 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1e77804c-d038-4e15-98c1-8e9d446429d7 req-46421c36-aefc-42f8-9c69-c7161907ce75 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0386245
May 25 16:44:48.870913 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:44:49.005751 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d,segment=NetworkSegment(24e045d0-637a-4a9d-af18-175fe9d4147a),segment_id=24e045d0-637a-4a9d-af18-175fe9d4147a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:44:49.018624 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': 'cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d', 'network_id': 'b737aee3-c586-4315-91bd-90bf18067410', 'port_id': 'cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d', 'mac_address': 'fa:16:3e:68:07:7c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 419, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '01b9c44a-4fab-499e-be63-34da3c8d98f4', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:44:49.073109 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:49.092804 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:44:49.108236 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d,segment=NetworkSegment(24e045d0-637a-4a9d-af18-175fe9d4147a),segment_id=24e045d0-637a-4a9d-af18-175fe9d4147a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:44:49.112164 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:49.113921 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-b4dc703f-4b23-41a2-bcfc-7cd2c4d49b0f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:49.178394 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:49.181216 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:49.379529 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:44:49.800830 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-547ab573-495d-4b63-a97b-717f8ce5cd67 req-7c16750e-7764-4328-8fe9-c2c39d89c1cd tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:49.802316 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-547ab573-495d-4b63-a97b-717f8ce5cd67 req-7c16750e-7764-4328-8fe9-c2c39d89c1cd tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 945 time: 0.0832641
May 25 16:44:49.847469 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-547ab573-495d-4b63-a97b-717f8ce5cd67 req-b92eaf5c-faf4-418f-9d57-3307cbea31ad tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391753
May 25 16:44:50.884399 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:44:50.955652 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:44:50.962455 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:44:50.962833 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:51.032077 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adc001c5-57d0-4bec-9592-ba3fa56780f6 req-8b87d808-9d9c-4565-b27a-73f0a71a973a tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:51.034053 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-adc001c5-57d0-4bec-9592-ba3fa56780f6 req-8b87d808-9d9c-4565-b27a-73f0a71a973a tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 945 time: 0.0814598
May 25 16:44:51.080004 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-adc001c5-57d0-4bec-9592-ba3fa56780f6 req-cf6133e2-7d8b-49b1-85b5-e70cb93ab616 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400085
May 25 16:44:51.080752 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:51.107437 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8014a243-8f63-40f1-95b7-9200f8a73636', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:44:51.117973 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d,segment=NetworkSegment(24e045d0-637a-4a9d-af18-175fe9d4147a),segment_id=24e045d0-637a-4a9d-af18-175fe9d4147a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:44:51.122531 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:51.124267 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:51.153594 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8014a243-8f63-40f1-95b7-9200f8a73636', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d', 'code': 200}
May 25 16:44:51.193382 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:51.200945 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:51.201295 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:51.201652 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:51.201978 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:51.202296 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:51.202611 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:51.202926 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:51.203239 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:51.203548 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:51.203854 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:51.204661 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:51.204982 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:51.209043 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:51.342175 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60356) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:51.385847 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b95d2d1-a329-4925-8e09-376468457f9f req-de70e2c0-ab70-4f47-aad2-2879e2fa4b78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:51.387237 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8b95d2d1-a329-4925-8e09-376468457f9f req-de70e2c0-ab70-4f47-aad2-2879e2fa4b78 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 1099 time: 0.0730069
May 25 16:44:51.429059 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8b95d2d1-a329-4925-8e09-376468457f9f req-6d44681b-4f18-41af-8268-73e78c086362 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0350091
May 25 16:44:51.732445 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Deleting port 76ff0ea7-d6c2-44d0-b079-eeede54cafe7 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:44:51.732700 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:51.848208 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:51.848528 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:51.969450 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Calling delete_port for 76ff0ea7-d6c2-44d0-b079-eeede54cafe7 owned by network:floatingip {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:44:52.191995 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:52.195865 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0be85798-623f-44e3-8bdb-96b08f5d6869 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:52.241373 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Pushing event deleted for resources: {'Port': ['ID=76ff0ea7-d6c2-44d0-b079-eeede54cafe7,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:52.246728 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:52.275295 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d465a87-047b-4de7-8836-582eece536ba req-f4ef8c0c-c665-4f20-905d-0a0a699b0395 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:52.277094 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3d465a87-047b-4de7-8836-582eece536ba req-f4ef8c0c-c665-4f20-905d-0a0a699b0395 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 946 time: 0.0883226
May 25 16:44:52.326339 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3d465a87-047b-4de7-8836-582eece536ba req-3d8b9ce0-6288-4cb6-89a5-b38a231b8bac tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427802
May 25 16:44:52.338627 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for floatingip, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:52.338954 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.l3_db [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Floating IP 0ad56454-abdb-48cc-8ff9-bb851ef5c302 disassociated (deleted). External IP: 172.27.3.131, port: f9f25895-4aec-487b-bcc9-f61318cb3aba.
May 25 16:44:52.696730 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Router d9f2f836-a3d4-438f-9259-98d8faf7dddd has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:44:52.874920 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:44:52.884013 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74ca3c61-2978-4f92-a275-d3ec27fbb1b3 None None] Sync routers for ids ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:44:52.887723 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:52.893529 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74ca3c61-2978-4f92-a275-d3ec27fbb1b3 None None] Routers {'d9f2f836-a3d4-438f-9259-98d8faf7dddd'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:44:52.894118 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-74ca3c61-2978-4f92-a275-d3ec27fbb1b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b7505e0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:44:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:44:52.942535 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-0730ca6b-ed97-4fd1-8caa-11c5a3d55906 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "DELETE /v2.0/floatingips/0ad56454-abdb-48cc-8ff9-bb851ef5c302 HTTP/1.1" status: 204  len: 168 time: 1.5992761
May 25 16:44:52.943187 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:44:52.990032 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'status': 'completed', 'code': 200}
May 25 16:44:53.076140 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-74ca3c61-2978-4f92-a275-d3ec27fbb1b3 None None] Set router d9f2f836-a3d4-438f-9259-98d8faf7dddd gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:44:53.098919 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6fb525b-9369-4b83-839b-c2e928d941e7 req-39778533-8a1f-4b6b-94c3-8e39c7535ed6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:53.100612 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b6fb525b-9369-4b83-839b-c2e928d941e7 req-39778533-8a1f-4b6b-94c3-8e39c7535ed6 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a723bbfba23f463dbb8da0bdacb4b0aa&device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 1098 time: 0.0794551
May 25 16:44:53.241124 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6fb525b-9369-4b83-839b-c2e928d941e7 req-5b30404b-d0b3-4d13-9ea6-b645941dc2c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:53.242706 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b6fb525b-9369-4b83-839b-c2e928d941e7 req-5b30404b-d0b3-4d13-9ea6-b645941dc2c3 service neutron] 10.222.0.76 "GET /v2.0/networks?id=3e40698a-e2cb-4812-9711-e3b481dbc8b3 HTTP/1.1" status: 200  len: 910 time: 0.1353073
May 25 16:44:53.350607 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b6fb525b-9369-4b83-839b-c2e928d941e7 req-4dcca2ed-0209-42a8-bb86-5a83ba633dfc service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba HTTP/1.1" status: 200  len: 217 time: 0.0736518
May 25 16:44:53.393532 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-74ca3c61-2978-4f92-a275-d3ec27fbb1b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b7505e0>, [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:39:37Z', 'revision_number': 4, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port': {'id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:a9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:32Z', 'updated_at': '2021-05-25T16:39:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd', 'name': '', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'mac_address': 'fa:16:3e:5a:26:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_interface', 'standard_attr_id': 377, 'fixed_ips': [{'subnet_id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:36Z', 'updated_at': '2021-05-25T16:39:45Z', 'revision_number': 5, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'subnets': [{'id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:44:53.397485 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74ca3c61-2978-4f92-a275-d3ec27fbb1b3 None None] Checking router: d9f2f836-a3d4-438f-9259-98d8faf7dddd for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:44:53.407134 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74ca3c61-2978-4f92-a275-d3ec27fbb1b3 None None] Routers {'d9f2f836-a3d4-438f-9259-98d8faf7dddd'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:44:53.407772 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-74ca3c61-2978-4f92-a275-d3ec27fbb1b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b7505e0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:44:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:44:53.434056 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6fb525b-9369-4b83-839b-c2e928d941e7 req-2b0fd2ac-af75-4ba9-beba-1370b126962d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:53.435459 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b6fb525b-9369-4b83-839b-c2e928d941e7 req-2b0fd2ac-af75-4ba9-beba-1370b126962d service neutron] 10.222.0.76 "GET /v2.0/subnets?id=6203ecab-ef7b-4872-ac7a-33ea4cfae323 HTTP/1.1" status: 200  len: 848 time: 0.0752783
May 25 16:44:53.519087 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f89f1ca-5aeb-4d2c-9fb6-5a99e1256759 req-ad9e4c85-53e2-4141-b9aa-223c9f06f5d7 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:53.520618 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2f89f1ca-5aeb-4d2c-9fb6-5a99e1256759 req-ad9e4c85-53e2-4141-b9aa-223c9f06f5d7 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.2750146
May 25 16:44:53.625292 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2f89f1ca-5aeb-4d2c-9fb6-5a99e1256759 req-834de2f2-038d-474d-b6be-44b087d4ee09 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0925138
May 25 16:44:53.632282 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-74ca3c61-2978-4f92-a275-d3ec27fbb1b3 None None] Set router d9f2f836-a3d4-438f-9259-98d8faf7dddd gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:44:53.646510 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aedd668-5d4e-4de3-a2bd-8a71f6ae5d80 req-df90cc17-d699-469f-b87d-7b9984bf410b tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:53.647967 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3aedd668-5d4e-4de3-a2bd-8a71f6ae5d80 req-df90cc17-d699-469f-b87d-7b9984bf410b tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 946 time: 0.2110953
May 25 16:44:53.652374 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6fb525b-9369-4b83-839b-c2e928d941e7 req-a166f7cc-58c8-43e2-a03c-4a669eaeee6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:53.653766 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b6fb525b-9369-4b83-839b-c2e928d941e7 req-a166f7cc-58c8-43e2-a03c-4a669eaeee6e service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=3e40698a-e2cb-4812-9711-e3b481dbc8b3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1793046
May 25 16:44:53.774242 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3aedd668-5d4e-4de3-a2bd-8a71f6ae5d80 req-77c28da9-ec2d-4db2-b24f-1cbf90741a88 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1194625
May 25 16:44:53.816947 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b6fb525b-9369-4b83-839b-c2e928d941e7 req-cd653566-d6ef-4829-a684-e6622aeed395 service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1496947
May 25 16:44:53.955126 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-74ca3c61-2978-4f92-a275-d3ec27fbb1b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b7505e0>, [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:39:37Z', 'revision_number': 4, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port': {'id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:a9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:32Z', 'updated_at': '2021-05-25T16:39:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd', 'name': '', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'mac_address': 'fa:16:3e:5a:26:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_interface', 'standard_attr_id': 377, 'fixed_ips': [{'subnet_id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:36Z', 'updated_at': '2021-05-25T16:39:45Z', 'revision_number': 5, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'subnets': [{'id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:44:53.955804 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b6fb525b-9369-4b83-839b-c2e928d941e7 req-fdfd51b2-6284-4c30-9a7f-96ef7ccff8f2 service neutron] 10.222.0.76 "GET /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1303456
May 25 16:44:53.959725 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74ca3c61-2978-4f92-a275-d3ec27fbb1b3 None None] The sync data for ids ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'] in dv-cinder-786386-6-iscsi is: [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:39:37Z', 'revision_number': 4, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port': {'id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:a9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:32Z', 'updated_at': '2021-05-25T16:39:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd', 'name': '', 'network_id': '3e40698a-e2cb-4812-9711-e3b481dbc8b3', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'mac_address': 'fa:16:3e:5a:26:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_interface', 'standard_attr_id': 377, 'fixed_ips': [{'subnet_id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:36Z', 'updated_at': '2021-05-25T16:39:45Z', 'revision_number': 5, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'subnets': [{'id': '6203ecab-ef7b-4872-ac7a-33ea4cfae323', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:44:54.175504 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29d752de-ed1e-45b6-ae41-c7b63a79854b None None] New status for floating IP 0ad56454-abdb-48cc-8ff9-bb851ef5c302: DOWN {{(pid=92014) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:44:54.819425 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1b7795c-e363-49cc-af76-0d2dae8024e9 req-6cbbdc04-ecdd-459b-ad37-eccfa3224436 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:54.821289 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a1b7795c-e363-49cc-af76-0d2dae8024e9 req-6cbbdc04-ecdd-459b-ad37-eccfa3224436 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.0824566
May 25 16:44:54.871026 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a1b7795c-e363-49cc-af76-0d2dae8024e9 req-a5390fad-5656-4e01-9f24-ad7458a358eb tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/security-groups?id=c290da32-99a9-4156-b987-67e510a15d61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0438318
May 25 16:44:55.105901 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe6144a3-ebd7-4418-bbb8-5208d0293641 req-064752a0-e333-45ed-95a3-13a4ca95188d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:44:55.107313 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fe6144a3-ebd7-4418-bbb8-5208d0293641 req-064752a0-e333-45ed-95a3-13a4ca95188d tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.76 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 945 time: 0.1673625
May 25 16:44:55.248415 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-fe6144a3-ebd7-4418-bbb8-5208d0293641 req-36f25447-1d8a-4434-b005-871c484fe8d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Deleting port f9f25895-4aec-487b-bcc9-f61318cb3aba {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:44:55.248760 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-fe6144a3-ebd7-4418-bbb8-5208d0293641 req-36f25447-1d8a-4434-b005-871c484fe8d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:55.383397 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-fe6144a3-ebd7-4418-bbb8-5208d0293641 req-36f25447-1d8a-4434-b005-871c484fe8d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] For port f9f25895-4aec-487b-bcc9-f61318cb3aba, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f9f25895-4aec-487b-bcc9-f61318cb3aba,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:44:55.383736 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-fe6144a3-ebd7-4418-bbb8-5208d0293641 req-36f25447-1d8a-4434-b005-871c484fe8d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:55.508154 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-fe6144a3-ebd7-4418-bbb8-5208d0293641 req-36f25447-1d8a-4434-b005-871c484fe8d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Calling delete_port for f9f25895-4aec-487b-bcc9-f61318cb3aba owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:44:55.641581 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-fe6144a3-ebd7-4418-bbb8-5208d0293641 req-36f25447-1d8a-4434-b005-871c484fe8d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:55.649156 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:55.695193 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36f25447-1d8a-4434-b005-871c484fe8d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Pushing event deleted for resources: {'Port': ['ID=f9f25895-4aec-487b-bcc9-f61318cb3aba,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:55.698346 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-36f25447-1d8a-4434-b005-871c484fe8d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:55.774978 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-fe6144a3-ebd7-4418-bbb8-5208d0293641 req-36f25447-1d8a-4434-b005-871c484fe8d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] No DVR routers for this DVR port f9f25895-4aec-487b-bcc9-f61318cb3aba on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:44:55.777468 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-fe6144a3-ebd7-4418-bbb8-5208d0293641 req-36f25447-1d8a-4434-b005-871c484fe8d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:55.779995 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'name': 'network-vif-deleted', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:44:55.787660 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fe6144a3-ebd7-4418-bbb8-5208d0293641 req-36f25447-1d8a-4434-b005-871c484fe8d4 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.76 "DELETE /v2.0/ports/f9f25895-4aec-487b-bcc9-f61318cb3aba HTTP/1.1" status: 204  len: 173 time: 0.6732965
May 25 16:44:55.826848 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '550a76ba-233b-4d54-8223-01267bd33511', 'name': 'network-vif-deleted', 'tag': 'f9f25895-4aec-487b-bcc9-f61318cb3aba', 'status': 'completed', 'code': 200}
May 25 16:44:56.019397 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-c05385a7-a2ad-4f3e-b90e-be9c971e2383 req-538b6e84-9b27-40f9-92ef-1f545c268b89 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Synchronizing usage tracker for tenant:a723bbfba23f463dbb8da0bdacb4b0aa on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:44:56.036123 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-c05385a7-a2ad-4f3e-b90e-be9c971e2383 req-538b6e84-9b27-40f9-92ef-1f545c268b89 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Unset dirty status for tenant:a723bbfba23f463dbb8da0bdacb4b0aa on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:44:56.037712 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c05385a7-a2ad-4f3e-b90e-be9c971e2383 req-538b6e84-9b27-40f9-92ef-1f545c268b89 tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "GET /v2.0/ports?device_id=550a76ba-233b-4d54-8223-01267bd33511 HTTP/1.1" status: 200  len: 210 time: 0.0617859
May 25 16:44:57.134180 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60440) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:57.208072 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:57.240592 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:57.311165 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:57.316082 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0e54a653-f905-4d89-a0ee-a084b670988c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:57.331638 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c290da32-99a9-4156-b987-67e510a15d61,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:57.341040 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:57.341441 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:57.341811 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:57.342169 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:57.342523 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:57.342875 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:57.343225 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:57.343572 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:57.343922 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:57.344267 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:57.344637 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:57.345593 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:44:57.351997 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:57.354100 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:57.355209 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-a1b2288e-a559-4c09-b11f-462429e5a1bd tempest-TestShelveInstance-1938948120 tempest-TestShelveInstance-1938948120-project] 10.222.0.73 "DELETE /v2.0/security-groups/c290da32-99a9-4156-b987-67e510a15d61 HTTP/1.1" status: 204  len: 168 time: 0.2200737
May 25 16:44:57.403033 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60448) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:44:58.114944 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-501288'] for router_interface, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:58.527595 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] Deleting port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:44:58.528272 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:58.660114 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] For port beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:44:58.660485 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:58.790292 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] Calling delete_port for beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd owned by network:router_interface {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:44:58.941581 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:58.947739 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2c756a06-3c0b-4d4e-95db-48bf12daef69 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:44:58.948863 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device f9f25895-4aec-487b-bcc9-f61318cb3aba no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:44:58.985268 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: f9f25895-4aec-487b-bcc9-f61318cb3aba {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:44:58.985703 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device f9f25895-4aec-487b-bcc9-f61318cb3aba not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:44:59.008858 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] Pushing event deleted for resources: {'Port': ['ID=beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:44:59.045236 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:44:59.287725 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1636838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-506040'] for router_interface, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:44:59.776017 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] Router d9f2f836-a3d4-438f-9259-98d8faf7dddd has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:44:59.962702 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:44:59.971217 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6db074a-b746-4dae-a7e2-e63a7e3b62a9 None None] Sync routers for ids ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:44:59.981637 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] 10.222.0.73 "PUT /v2.0/routers/d9f2f836-a3d4-438f-9259-98d8faf7dddd/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5772660
May 25 16:44:59.983792 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6db074a-b746-4dae-a7e2-e63a7e3b62a9 None None] Routers {'d9f2f836-a3d4-438f-9259-98d8faf7dddd'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:44:59.984817 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-e6db074a-b746-4dae-a7e2-e63a7e3b62a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b7c3730>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:44:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:44:59.985802 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60460) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:00.168000 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-e6db074a-b746-4dae-a7e2-e63a7e3b62a9 None None] Set router d9f2f836-a3d4-438f-9259-98d8faf7dddd gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:00.170590 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Notify callbacks [] for router, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:00.350992 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:00.427323 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Deleting port ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:00.427562 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:00.453857 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-e6db074a-b746-4dae-a7e2-e63a7e3b62a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b7c3730>, [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:44:58Z', 'revision_number': 5, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port': {'id': 'ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:a9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:32Z', 'updated_at': '2021-05-25T16:39:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:00.457789 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6db074a-b746-4dae-a7e2-e63a7e3b62a9 None None] Checking router: d9f2f836-a3d4-438f-9259-98d8faf7dddd for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:45:00.465886 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6db074a-b746-4dae-a7e2-e63a7e3b62a9 None None] Routers {'d9f2f836-a3d4-438f-9259-98d8faf7dddd'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:00.466536 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-e6db074a-b746-4dae-a7e2-e63a7e3b62a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b7c3730>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:44:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:00.553857 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] For port ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:00.554207 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:00.622118 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-e6db074a-b746-4dae-a7e2-e63a7e3b62a9 None None] Set router d9f2f836-a3d4-438f-9259-98d8faf7dddd gateway port host: None {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:00.678858 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Calling delete_port for ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec owned by network:router_gateway {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:00.738990 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-e6db074a-b746-4dae-a7e2-e63a7e3b62a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b7c3730>, [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:45:00Z', 'revision_number': 6, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port_host': None}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:00.743663 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6db074a-b746-4dae-a7e2-e63a7e3b62a9 None None] The sync data for ids ['d9f2f836-a3d4-438f-9259-98d8faf7dddd'] in dv-cinder-786386-6-iscsi is: [{'id': 'd9f2f836-a3d4-438f-9259-98d8faf7dddd', 'name': 'tempest-TestShelveInstance-1661198402-router', 'tenant_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:31Z', 'updated_at': '2021-05-25T16:45:00Z', 'revision_number': 6, 'project_id': 'a723bbfba23f463dbb8da0bdacb4b0aa', 'gw_port_host': None}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:45:00.833817 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:00.837607 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-24db5c7a-247d-4a24-872d-9e6293d8ceb8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:00.913879 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Pushing event deleted for resources: {'Port': ['ID=ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:00.920560 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:01.104387 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-501045'] for router_gateway, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:01.287198 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-507064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2357'] for router, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:01.289351 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:01.312480 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-507780'] for router, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:01.313125 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d9f2f836-a3d4-438f-9259-98d8faf7dddd {{(pid=92012) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 16:45:01.326320 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Notify callbacks [] for router, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:01.327439 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] 10.222.0.73 "DELETE /v2.0/routers/d9f2f836-a3d4-438f-9259-98d8faf7dddd HTTP/1.1" status: 204  len: 168 time: 1.3407192
May 25 16:45:01.330728 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60466) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:01.392627 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_v2 [None req-2a8f6b69-ec8c-4485-ae84-d5641eb6d81a admin admin] Deleting subnet 6203ecab-ef7b-4872-ac7a-33ea4cfae323 {{(pid=92012) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:45:01.395674 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2a8f6b69-ec8c-4485-ae84-d5641eb6d81a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:01.427720 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-0394d0d3-d331-4981-8b13-cc5bfccf4a9c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:01.449427 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2a8f6b69-ec8c-4485-ae84-d5641eb6d81a admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-976079'] for subnet, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:01.574376 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:01.579969 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2a8f6b69-ec8c-4485-ae84-d5641eb6d81a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:01.621240 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:01.621665 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device beaa0e8f-cf2a-417d-bcd5-1f7441ad91bd not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:01.622036 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:01.662770 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:01.663124 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device ca03c2f7-cb18-4ddc-aa52-b3b9c62e9fec not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:01.847990 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2a8f6b69-ec8c-4485-ae84-d5641eb6d81a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7721505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-697619'] for subnet, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:01.851830 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:01.891197 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a8f6b69-ec8c-4485-ae84-d5641eb6d81a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6203ecab-ef7b-4872-ac7a-33ea4cfae323,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:01.893723 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2a8f6b69-ec8c-4485-ae84-d5641eb6d81a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:01.896416 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2a8f6b69-ec8c-4485-ae84-d5641eb6d81a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:01.901635 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5662cb3-f02c-47b3-b7a0-6f3deda269c8 None None] Network 3e40698a-e2cb-4812-9711-e3b481dbc8b3 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:45:01.902360 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-2a8f6b69-ec8c-4485-ae84-d5641eb6d81a admin admin] 10.222.0.73 "DELETE /v2.0/subnets/6203ecab-ef7b-4872-ac7a-33ea4cfae323 HTTP/1.1" status: 204  len: 168 time: 0.5706606
May 25 16:45:01.904749 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60472) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:02.014866 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:02.089748 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Deleting port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:02.090084 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:02.156175 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03719d9f-affb-4c70-8552-904a06f46220 None None] DHCP port deletion for 3e40698a-e2cb-4812-9711-e3b481dbc8b3 request from dv-cinder-786386-6-iscsi {{(pid=92014) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 16:45:02.198497 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] For port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:02.198851 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:02.227376 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-03719d9f-affb-4c70-8552-904a06f46220 None None] Deleting port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 {{(pid=92014) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:02.227756 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-03719d9f-affb-4c70-8552-904a06f46220 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:02.325951 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Calling delete_port for 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 owned by network:dhcp {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:02.330149 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-03719d9f-affb-4c70-8552-904a06f46220 None None] For port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8,segment=NetworkSegment(19ecc07e-d399-4943-af92-0daf09e9ec93),segment_id=19ecc07e-d399-4943-af92-0daf09e9ec93)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:02.330549 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-03719d9f-affb-4c70-8552-904a06f46220 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:02.373314 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:02.379012 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-d7c46fba-2359-4521-acb3-c5d2d891013b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:02.427022 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] No DVR routers for this DVR port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 on host dv-cinder-786386-6-iscsi {{(pid=92012) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:02.428766 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Pushing event deleted for resources: {'Port': ['ID=9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:02.457714 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-03719d9f-affb-4c70-8552-904a06f46220 None None] Calling delete_port for 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 owned by network:dhcp {{(pid=92014) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:02.458790 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:02.501666 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-03719d9f-affb-4c70-8552-904a06f46220 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244'] for port, after_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:02.505560 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:02.550308 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03719d9f-affb-4c70-8552-904a06f46220 None None] Pushing event deleted for resources: {'Port': ['ID=9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8,revision_number=None']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:02.553693 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-03719d9f-affb-4c70-8552-904a06f46220 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:02.554540 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03719d9f-affb-4c70-8552-904a06f46220 None None] No DVR routers for this DVR port 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 on host dv-cinder-786386-6-iscsi {{(pid=92014) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:02.648243 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:02.663092 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346b226820>,) {'filters': {'network_id': ['3e40698a-e2cb-4812-9711-e3b481dbc8b3']}} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:02.676075 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b226820>, '19ecc07e-d399-4943-af92-0daf09e9ec93') {'for_net_delete': True} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:02.676370 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b226820>, '19ecc07e-d399-4943-af92-0daf09e9ec93') {} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:02.688065 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-976068'] for segment, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:02.705232 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:02.711977 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Releasing vlan 401 on physical network physnet1 to pool {{(pid=92012) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:45:02.712371 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7823239'] for segment, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]: Traceback (most recent call last):
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     timer()
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     cb(*args, **kw)
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     return func(*args, **kwargs)
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     self._notify()
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     self.callback(batched_events)
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     event.method(event)
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     return f(self, *a, **k)
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._get(url).json()
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self.request(url, 'GET', **kwargs)
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:45:02.725891 dv-cinder-786386-6-iscsi neutron-server[92012]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:45:02.804289 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:02.810547 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:02.824078 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:02.834248 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Pushing event deleted for resources: {'Network': ['ID=3e40698a-e2cb-4812-9711-e3b481dbc8b3,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:02.837249 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:02.848569 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-bbeff45e-4d20-43d0-a82a-f7743009959a admin admin] 10.222.0.73 "DELETE /v2.0/networks/3e40698a-e2cb-4812-9711-e3b481dbc8b3 HTTP/1.1" status: 204  len: 168 time: 0.9428394
May 25 16:45:02.851643 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60478) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:03.292049 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:03.330577 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:03.331016 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 9d2f32d6-d78e-4a92-bed9-8d36eeccbaf8 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:03.412115 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-73e12142-094a-4d73-accf-40f14ec35281 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-501288'] for router_interface, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:03.839690 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:03.857667 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-73e12142-094a-4d73-accf-40f14ec35281 admin admin] Deleting port c9b1428b-1669-4a0f-a8a6-102a89f7af1e {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:03.858172 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-73e12142-094a-4d73-accf-40f14ec35281 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:03.979568 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-73e12142-094a-4d73-accf-40f14ec35281 admin admin] For port c9b1428b-1669-4a0f-a8a6-102a89f7af1e, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=c9b1428b-1669-4a0f-a8a6-102a89f7af1e,segment=NetworkSegment(80d0c339-d557-4898-a197-cde1821f5d83),segment_id=80d0c339-d557-4898-a197-cde1821f5d83)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:03.979917 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-73e12142-094a-4d73-accf-40f14ec35281 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:04.119973 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-22cdbd71-14b5-44a1-b170-9138514f5e68 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:04.211188 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-73e12142-094a-4d73-accf-40f14ec35281 admin admin] Calling delete_port for c9b1428b-1669-4a0f-a8a6-102a89f7af1e owned by network:router_interface {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:04.367689 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-73e12142-094a-4d73-accf-40f14ec35281 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:04.371834 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-316d328d-71f4-41e9-8292-01fa3b5308a1 tempest-VolumesActionsTest-455603831 tempest-VolumesActionsTest-455603831-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:04.417378 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73e12142-094a-4d73-accf-40f14ec35281 admin admin] Pushing event deleted for resources: {'Port': ['ID=c9b1428b-1669-4a0f-a8a6-102a89f7af1e,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:04.419789 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-73e12142-094a-4d73-accf-40f14ec35281 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:04.688933 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-73e12142-094a-4d73-accf-40f14ec35281 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1636838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-506040'] for router_interface, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:05.054834 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-73e12142-094a-4d73-accf-40f14ec35281 admin admin] Router fae4d531-8061-45ac-a2da-891f8e090ef1 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:45:05.068282 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:05.255093 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-73e12142-094a-4d73-accf-40f14ec35281 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:45:05.265238 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d64d0590-b1b4-49cb-af15-80ebd63b3f59 None None] Sync routers for ids ['fae4d531-8061-45ac-a2da-891f8e090ef1'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:45:05.279667 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d64d0590-b1b4-49cb-af15-80ebd63b3f59 None None] Routers {'fae4d531-8061-45ac-a2da-891f8e090ef1'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:05.279881 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-73e12142-094a-4d73-accf-40f14ec35281 admin admin] 10.222.0.73 "PUT /v2.0/routers/fae4d531-8061-45ac-a2da-891f8e090ef1/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4245732
May 25 16:45:05.279976 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d64d0590-b1b4-49cb-af15-80ebd63b3f59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b95a910>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['fae4d531-8061-45ac-a2da-891f8e090ef1'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:05.280088 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60488) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:05.466418 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Notify callbacks [] for router, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:05.474069 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-d64d0590-b1b4-49cb-af15-80ebd63b3f59 None None] Set router fae4d531-8061-45ac-a2da-891f8e090ef1 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:05.768947 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:05.829241 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d64d0590-b1b4-49cb-af15-80ebd63b3f59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b95a910>, [{'id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'name': 'tempest-TestShelveInstance-1530563751-router', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232'}], 'enable_snat': True}, 'gw_port_id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:40Z', 'updated_at': '2021-05-25T16:45:04Z', 'revision_number': 5, 'project_id': '3aa35a088d0242458aafe4c1b207fec3', 'gw_port': {'id': 'd7227a1e-9b2e-47b8-9143-9c7dbed387f2', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:33:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 389, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:39:42Z', 'updated_at': '2021-05-25T16:39:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:05.833371 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d64d0590-b1b4-49cb-af15-80ebd63b3f59 None None] Checking router: fae4d531-8061-45ac-a2da-891f8e090ef1 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:45:05.842344 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d64d0590-b1b4-49cb-af15-80ebd63b3f59 None None] Routers {'fae4d531-8061-45ac-a2da-891f8e090ef1'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:05.843227 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d64d0590-b1b4-49cb-af15-80ebd63b3f59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b95a910>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['fae4d531-8061-45ac-a2da-891f8e090ef1'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:05.845991 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Deleting port d7227a1e-9b2e-47b8-9143-9c7dbed387f2 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:05.846334 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:05.972404 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] For port d7227a1e-9b2e-47b8-9143-9c7dbed387f2, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=d7227a1e-9b2e-47b8-9143-9c7dbed387f2,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:05.972764 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:05.997529 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-d64d0590-b1b4-49cb-af15-80ebd63b3f59 None None] Set router fae4d531-8061-45ac-a2da-891f8e090ef1 gateway port host: None {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:06.098708 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Calling delete_port for d7227a1e-9b2e-47b8-9143-9c7dbed387f2 owned by network:router_gateway {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:06.104294 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d64d0590-b1b4-49cb-af15-80ebd63b3f59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b95a910>, [{'id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'name': 'tempest-TestShelveInstance-1530563751-router', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:40Z', 'updated_at': '2021-05-25T16:45:05Z', 'revision_number': 6, 'project_id': '3aa35a088d0242458aafe4c1b207fec3', 'gw_port_host': None}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:06.108264 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d64d0590-b1b4-49cb-af15-80ebd63b3f59 None None] The sync data for ids ['fae4d531-8061-45ac-a2da-891f8e090ef1'] in dv-cinder-786386-6-iscsi is: [{'id': 'fae4d531-8061-45ac-a2da-891f8e090ef1', 'name': 'tempest-TestShelveInstance-1530563751-router', 'tenant_id': '3aa35a088d0242458aafe4c1b207fec3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:39:40Z', 'updated_at': '2021-05-25T16:45:05Z', 'revision_number': 6, 'project_id': '3aa35a088d0242458aafe4c1b207fec3', 'gw_port_host': None}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:45:06.242717 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:06.246415 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-8e1804af-9811-4d23-a0c3-935683f76fd4 tempest-AttachVolumeNegativeTest-2107482034 tempest-AttachVolumeNegativeTest-2107482034-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:06.293675 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Pushing event deleted for resources: {'Port': ['ID=d7227a1e-9b2e-47b8-9143-9c7dbed387f2,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:06.296092 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:06.389801 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-501045'] for router_gateway, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:06.573173 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-507064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2357'] for router, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:06.575412 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:06.586084 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:06.599991 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-507780'] for router, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:06.600479 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Fanout notify agent at l3_agent the message router_deleted on router fae4d531-8061-45ac-a2da-891f8e090ef1 {{(pid=92012) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 16:45:06.612365 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] Notify callbacks [] for router, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:06.613618 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-7faefdb0-6356-4c07-aeab-f75ebdf36de4 admin admin] 10.222.0.73 "DELETE /v2.0/routers/fae4d531-8061-45ac-a2da-891f8e090ef1 HTTP/1.1" status: 204  len: 168 time: 1.3320560
May 25 16:45:06.616029 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60494) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:06.679778 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_v2 [None req-34abaac1-b3ae-40e1-99b1-b4924374babb admin admin] Deleting subnet c6bfd6f1-5436-48ae-aff5-b61d9efcb1da {{(pid=92012) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:45:06.682940 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-34abaac1-b3ae-40e1-99b1-b4924374babb admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:06.732989 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-34abaac1-b3ae-40e1-99b1-b4924374babb admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-976079'] for subnet, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:06.820002 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-34abaac1-b3ae-40e1-99b1-b4924374babb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.073089 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-34abaac1-b3ae-40e1-99b1-b4924374babb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7721505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-697619'] for subnet, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.076822 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:07.116076 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34abaac1-b3ae-40e1-99b1-b4924374babb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c6bfd6f1-5436-48ae-aff5-b61d9efcb1da,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:07.119110 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-34abaac1-b3ae-40e1-99b1-b4924374babb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:07.120086 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-34abaac1-b3ae-40e1-99b1-b4924374babb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.124631 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a101adff-fb1c-4c6d-804f-60b2954ed3fb None None] Network ca530aa1-a332-4315-a736-76ee81fb8b29 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:45:07.126672 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-34abaac1-b3ae-40e1-99b1-b4924374babb admin admin] 10.222.0.73 "DELETE /v2.0/subnets/c6bfd6f1-5436-48ae-aff5-b61d9efcb1da HTTP/1.1" status: 204  len: 168 time: 0.5097136
May 25 16:45:07.129154 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60510) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:07.237557 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.302921 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device d7227a1e-9b2e-47b8-9143-9c7dbed387f2 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:07.312047 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Deleting port e14194d6-6e64-4ab6-8cc7-b801cf1c0174 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:07.312384 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.343274 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: d7227a1e-9b2e-47b8-9143-9c7dbed387f2 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:07.343619 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device d7227a1e-9b2e-47b8-9143-9c7dbed387f2 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:07.344031 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device c9b1428b-1669-4a0f-a8a6-102a89f7af1e no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:07.381733 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: c9b1428b-1669-4a0f-a8a6-102a89f7af1e {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:07.382083 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device c9b1428b-1669-4a0f-a8a6-102a89f7af1e not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:07.446369 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-981b6f1e-af71-4090-863f-bcd402351f2d None None] DHCP port deletion for ca530aa1-a332-4315-a736-76ee81fb8b29 request from dv-cinder-786386-6-iscsi {{(pid=92014) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 16:45:07.514936 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-981b6f1e-af71-4090-863f-bcd402351f2d None None] Deleting port e14194d6-6e64-4ab6-8cc7-b801cf1c0174 {{(pid=92014) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:07.515319 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-981b6f1e-af71-4090-863f-bcd402351f2d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.518636 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] For port e14194d6-6e64-4ab6-8cc7-b801cf1c0174, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=e14194d6-6e64-4ab6-8cc7-b801cf1c0174,segment=NetworkSegment(80d0c339-d557-4898-a197-cde1821f5d83),segment_id=80d0c339-d557-4898-a197-cde1821f5d83)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:07.518988 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.611953 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-981b6f1e-af71-4090-863f-bcd402351f2d None None] For port e14194d6-6e64-4ab6-8cc7-b801cf1c0174, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=e14194d6-6e64-4ab6-8cc7-b801cf1c0174,segment=NetworkSegment(80d0c339-d557-4898-a197-cde1821f5d83),segment_id=80d0c339-d557-4898-a197-cde1821f5d83)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:07.612443 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-981b6f1e-af71-4090-863f-bcd402351f2d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.643932 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Calling delete_port for e14194d6-6e64-4ab6-8cc7-b801cf1c0174 owned by network:dhcp {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:07.696798 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.700605 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ae473953-3499-4579-9216-83c905ab2b17 tempest-ServerRescueNegativeTestJSON-641409271 tempest-ServerRescueNegativeTestJSON-641409271-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:07.745773 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-981b6f1e-af71-4090-863f-bcd402351f2d None None] Calling delete_port for e14194d6-6e64-4ab6-8cc7-b801cf1c0174 owned by network:dhcp {{(pid=92014) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:07.748046 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Pushing event deleted for resources: {'Port': ['ID=e14194d6-6e64-4ab6-8cc7-b801cf1c0174,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:07.749865 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] No DVR routers for this DVR port e14194d6-6e64-4ab6-8cc7-b801cf1c0174 on host dv-cinder-786386-6-iscsi {{(pid=92012) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:07.751745 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:07.798788 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-981b6f1e-af71-4090-863f-bcd402351f2d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244'] for port, after_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.802286 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:07.851535 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-981b6f1e-af71-4090-863f-bcd402351f2d None None] Pushing event deleted for resources: {'Port': ['ID=e14194d6-6e64-4ab6-8cc7-b801cf1c0174,revision_number=None']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:07.853328 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-981b6f1e-af71-4090-863f-bcd402351f2d None None] No DVR routers for this DVR port e14194d6-6e64-4ab6-8cc7-b801cf1c0174 on host dv-cinder-786386-6-iscsi {{(pid=92014) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:07.854701 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-981b6f1e-af71-4090-863f-bcd402351f2d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:07.874043 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.887323 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346a121df0>,) {'filters': {'network_id': ['ca530aa1-a332-4315-a736-76ee81fb8b29']}} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:07.899046 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346a121df0>, '80d0c339-d557-4898-a197-cde1821f5d83') {'for_net_delete': True} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:07.899340 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346a121df0>, '80d0c339-d557-4898-a197-cde1821f5d83') {} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:07.910295 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-976068'] for segment, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.926214 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.932442 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Releasing vlan 429 on physical network physnet1 to pool {{(pid=92012) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:45:07.932816 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7823239'] for segment, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]: Traceback (most recent call last):
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     timer()
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     cb(*args, **kw)
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     return func(*args, **kwargs)
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     self._notify()
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     self.callback(batched_events)
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     event.method(event)
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     return f(self, *a, **k)
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._get(url).json()
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self.request(url, 'GET', **kwargs)
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:45:07.946123 dv-cinder-786386-6-iscsi neutron-server[92012]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:45:08.021817 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:08.030604 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:08.043636 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:08.054113 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Pushing event deleted for resources: {'Network': ['ID=ca530aa1-a332-4315-a736-76ee81fb8b29,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:08.058410 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:08.061714 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] 10.222.0.73 "DELETE /v2.0/networks/ca530aa1-a332-4315-a736-76ee81fb8b29 HTTP/1.1" status: 204  len: 168 time: 0.9315903
May 25 16:45:08.179530 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60520) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:08.226984 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-11ec3bf4-0a46-4931-9295-adbd7e357290 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=a723bbfba23f463dbb8da0bdacb4b0aa&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0462432
May 25 16:45:08.229274 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60524) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:08.286059 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0f5e56e3-ab5f-4d7f-a312-82a858aec1ec admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:08.311500 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0f5e56e3-ab5f-4d7f-a312-82a858aec1ec admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:08.367735 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0f5e56e3-ab5f-4d7f-a312-82a858aec1ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:08.371737 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f8f8e303-316c-4496-a27d-903df9da934b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:08.386850 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f5e56e3-ab5f-4d7f-a312-82a858aec1ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7509affe-c1e4-4a50-a09a-a747b31827d3,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:08.390711 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-0f5e56e3-ab5f-4d7f-a312-82a858aec1ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:08.394467 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-0f5e56e3-ab5f-4d7f-a312-82a858aec1ec admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:08.395929 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-0f5e56e3-ab5f-4d7f-a312-82a858aec1ec admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/7509affe-c1e4-4a50-a09a-a747b31827d3 HTTP/1.1" status: 204  len: 168 time: 0.1654713
May 25 16:45:08.762465 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60542) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:08.814270 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c09a3b79-570d-4435-8e7e-f91193b3544e admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=3aa35a088d0242458aafe4c1b207fec3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0498531
May 25 16:45:08.816644 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60546) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:08.874238 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-174069a8-e97d-4df7-87ab-9c0fdbc6fe55 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:08.879367 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f16d8e40-4d36-4901-a9de-128663c95e3e req-f5c55f27-8e7a-4413-9995-bf1850fb10ac tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:08.880954 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f16d8e40-4d36-4901-a9de-128663c95e3e req-f5c55f27-8e7a-4413-9995-bf1850fb10ac tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 946 time: 0.0814493
May 25 16:45:08.901716 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-174069a8-e97d-4df7-87ab-9c0fdbc6fe55 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:08.929394 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f16d8e40-4d36-4901-a9de-128663c95e3e req-0c5c0d1e-896b-41c4-b055-0cf28348d911 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0423596
May 25 16:45:08.954745 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-174069a8-e97d-4df7-87ab-9c0fdbc6fe55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:08.958612 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-dd4d0fd4-ed6a-49bf-a5a0-611039ef3a5c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:08.970526 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-174069a8-e97d-4df7-87ab-9c0fdbc6fe55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d08640ca-c07d-444d-a190-5c5294062f76,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:08.972806 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-174069a8-e97d-4df7-87ab-9c0fdbc6fe55 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:08.979604 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-174069a8-e97d-4df7-87ab-9c0fdbc6fe55 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:08.980708 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-174069a8-e97d-4df7-87ab-9c0fdbc6fe55 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/d08640ca-c07d-444d-a190-5c5294062f76 HTTP/1.1" status: 204  len: 168 time: 0.1631024
May 25 16:45:09.285624 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device e14194d6-6e64-4ab6-8cc7-b801cf1c0174 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:09.365529 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: e14194d6-6e64-4ab6-8cc7-b801cf1c0174 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:09.365879 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device e14194d6-6e64-4ab6-8cc7-b801cf1c0174 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:09.978110 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fac29916-e275-4c63-815d-a08c4bbd94db req-1c8182d7-9046-4d20-bb16-9d64f20629b1 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:09.979585 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fac29916-e275-4c63-815d-a08c4bbd94db req-1c8182d7-9046-4d20-bb16-9d64f20629b1 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 946 time: 0.0799575
May 25 16:45:10.024484 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fac29916-e275-4c63-815d-a08c4bbd94db req-f7a2144f-1ab7-4fcd-a3a3-7e3924f82065 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392690
May 25 16:45:10.124767 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e200e6cc-8471-4e89-b262-d705f8c3af51 req-fe098fd5-e217-4c19-b1fd-cb7e45ac0677 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:10.126940 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e200e6cc-8471-4e89-b262-d705f8c3af51 req-fe098fd5-e217-4c19-b1fd-cb7e45ac0677 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 946 time: 0.0836637
May 25 16:45:10.181177 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e200e6cc-8471-4e89-b262-d705f8c3af51 req-818d3fd0-05c5-4dca-b14f-c5f89c2c60b4 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0455637
May 25 16:45:10.643596 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-e27ccb3c-7380-46c7-9104-0e77f521ba39 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:10.644987 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-e27ccb3c-7380-46c7-9104-0e77f521ba39 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.76 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 946 time: 0.0787137
May 25 16:45:10.781672 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Deleting port 5c47c017-af78-4c20-a79c-f54715856946 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:10.782065 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:10.916004 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] For port 5c47c017-af78-4c20-a79c-f54715856946, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=5c47c017-af78-4c20-a79c-f54715856946,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:10.916366 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:11.419496 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:11.420155 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:11.420370 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.l3_db [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Floating IP 52e4edda-6b53-4831-a933-8fabaef8ff01 disassociated. External IP: 172.27.3.99, port: 5c47c017-af78-4c20-a79c-f54715856946.
May 25 16:45:11.420743 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Calling delete_port for 5c47c017-af78-4c20-a79c-f54715856946 owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:11.463571 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2be98564-2781-4318-953c-a00ae2d4b1f0 req-60e4a7b5-b79f-4c00-9a78-2bdd5800a194 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:11.465096 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2be98564-2781-4318-953c-a00ae2d4b1f0 req-60e4a7b5-b79f-4c00-9a78-2bdd5800a194 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 946 time: 0.2802424
May 25 16:45:11.538099 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eba85829-e69a-43f8-a47d-b0d645b6897f req-8d5ea070-96dd-4fce-a98e-ecfcc90f8aab tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:11.539563 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eba85829-e69a-43f8-a47d-b0d645b6897f req-8d5ea070-96dd-4fce-a98e-ecfcc90f8aab tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 946 time: 0.1836207
May 25 16:45:11.547989 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2be98564-2781-4318-953c-a00ae2d4b1f0 req-05772168-e784-4a7d-9799-7ae3c99d7145 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0703235
May 25 16:45:11.637946 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-eba85829-e69a-43f8-a47d-b0d645b6897f req-a935ac2c-f5de-417a-a199-a432940caa37 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups?id=409cae44-c363-4438-9964-178dc61344f5&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0828235
May 25 16:45:11.709627 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:11.725526 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-311dc29e-ff13-46d6-bdf9-ae85a93950cb tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:11.783969 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event deleted for resources: {'Port': ['ID=5c47c017-af78-4c20-a79c-f54715856946,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:11.797875 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:11.798246 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:11.798609 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:11.798966 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:11.799317 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:11.799668 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:11.800017 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:11.800361 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:11.800730 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:11.801074 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:11.801434 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:11.801781 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:11.877382 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:11.907275 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-668326db-039c-4392-8693-373b7989138b tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:11.908624 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-668326db-039c-4392-8693-373b7989138b tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 946 time: 0.2676997
May 25 16:45:12.099760 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:45:12.229771 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Deleting port 0125dd82-e845-45e1-94c0-4e9afabfecdb {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:12.230117 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:12.417229 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:45:12.428023 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12b826d1-ea50-416d-b2bc-14fbefa99154 None None] Sync routers for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:45:12.438964 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12b826d1-ea50-416d-b2bc-14fbefa99154 None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:12.439525 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-12b826d1-ea50-416d-b2bc-14fbefa99154 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b7c32e0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:12.516155 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] No DVR routers for this DVR port 5c47c017-af78-4c20-a79c-f54715856946 on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:12.518825 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] For port 0125dd82-e845-45e1-94c0-4e9afabfecdb, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0125dd82-e845-45e1-94c0-4e9afabfecdb,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:12.519182 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:12.526977 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:12.529350 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'name': 'network-vif-deleted', 'tag': '5c47c017-af78-4c20-a79c-f54715856946'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:45:12.595965 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f', 'name': 'network-vif-deleted', 'tag': '5c47c017-af78-4c20-a79c-f54715856946', 'status': 'completed', 'code': 200}
May 25 16:45:12.617695 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b60f6986-2f8d-4c08-bef6-8047383b29a2 req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.76 "DELETE /v2.0/ports/5c47c017-af78-4c20-a79c-f54715856946 HTTP/1.1" status: 204  len: 173 time: 1.9659984
May 25 16:45:12.636825 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:45:12.649973 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-12b826d1-ea50-416d-b2bc-14fbefa99154 None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:12.937068 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-9d4d1b8a-e6a4-46f5-ad2d-dd63d75b550f req-3348164e-569d-418e-a3b6-ad3b771050e6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Synchronizing usage tracker for tenant:9c4a08443867402386f8ec58d2615739 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:45:13.054900 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-12b826d1-ea50-416d-b2bc-14fbefa99154 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b7c32e0>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:59Z', 'revision_number': 5, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:13.056683 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-9d4d1b8a-e6a4-46f5-ad2d-dd63d75b550f req-3348164e-569d-418e-a3b6-ad3b771050e6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Unset dirty status for tenant:9c4a08443867402386f8ec58d2615739 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:45:13.059296 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12b826d1-ea50-416d-b2bc-14fbefa99154 None None] Checking router: c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:45:13.061873 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9d4d1b8a-e6a4-46f5-ad2d-dd63d75b550f req-3348164e-569d-418e-a3b6-ad3b771050e6 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/ports?device_id=e5f1e9a4-a890-4a94-a7f2-2c4bb8ed6b5f HTTP/1.1" status: 200  len: 210 time: 0.2308371
May 25 16:45:13.069356 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12b826d1-ea50-416d-b2bc-14fbefa99154 None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:13.070169 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-12b826d1-ea50-416d-b2bc-14fbefa99154 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b7c32e0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:13.095481 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:13.095940 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:13.096587 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.l3_db [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Floating IP 0c27c2b0-a5a4-4301-aeed-262ea696bb1c disassociated. External IP: 172.27.3.243, port: 0125dd82-e845-45e1-94c0-4e9afabfecdb.
May 25 16:45:13.096768 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Calling delete_port for 0125dd82-e845-45e1-94c0-4e9afabfecdb owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:13.112794 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f738e8-9ea0-4d08-9435-f721e6c356e5 req-f24b4e0a-d8b5-44c4-a96d-2ca2c6fdf3d2 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:13.114564 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e2f738e8-9ea0-4d08-9435-f721e6c356e5 req-f24b4e0a-d8b5-44c4-a96d-2ca2c6fdf3d2 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 946 time: 0.4140048
May 25 16:45:13.180067 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-e2f738e8-9ea0-4d08-9435-f721e6c356e5 req-71a1ef05-8a1d-495d-a1d7-e6ec925eff68 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0532017
May 25 16:45:13.281079 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-12b826d1-ea50-416d-b2bc-14fbefa99154 None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:13.290440 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:13.297552 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-04480b40-4d23-42d0-9869-299ccddb3557 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:13.357000 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event deleted for resources: {'Port': ['ID=0125dd82-e845-45e1-94c0-4e9afabfecdb,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:13.362758 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:13.554746 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Router 3ec8f109-cb75-4f41-81bd-ca78638538c9 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:45:13.632199 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-12b826d1-ea50-416d-b2bc-14fbefa99154 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b7c32e0>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:59Z', 'revision_number': 5, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:13.635931 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12b826d1-ea50-416d-b2bc-14fbefa99154 None None] The sync data for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi is: [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:38:50Z', 'revision_number': 4, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '102d0170-5098-4810-8f03-423e54159dd7', 'name': '', 'network_id': 'b8cabc9a-0f6f-485c-8020-441b42ac019b', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'mac_address': 'fa:16:3e:df:c8:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 297, 'fixed_ips': [{'subnet_id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:49Z', 'updated_at': '2021-05-25T16:38:59Z', 'revision_number': 5, 'project_id': '9c4a08443867402386f8ec58d2615739', 'subnets': [{'id': '950695d6-8663-4ed4-92fd-b43d8ea5a820', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:45:13.746826 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:45:13.759813 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-767ab5cc-1a74-4397-a2be-d4f1a66262d5 None None] Sync routers for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:45:13.770651 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-767ab5cc-1a74-4397-a2be-d4f1a66262d5 None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:13.771448 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-767ab5cc-1a74-4397-a2be-d4f1a66262d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346a9412e0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:13.823678 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] No DVR routers for this DVR port 0125dd82-e845-45e1-94c0-4e9afabfecdb on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:13.826841 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:13.853328 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4bf95382-2cb2-43be-981f-b6f924c7be4b req-bf0688d3-f343-428c-acbb-3bdc592d930e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "DELETE /v2.0/ports/0125dd82-e845-45e1-94c0-4e9afabfecdb HTTP/1.1" status: 204  len: 173 time: 1.8854425
May 25 16:45:13.929980 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94ded157-1677-4b2e-b8c8-310e85046199 None None] New status for floating IP 52e4edda-6b53-4831-a933-8fabaef8ff01: DOWN {{(pid=92015) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:45:13.978409 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-767ab5cc-1a74-4397-a2be-d4f1a66262d5 None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:14.200439 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 60590) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:14.243355 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:14.336287 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ca54de1d-e9e9-4154-856d-ec5683a7a25e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:14.363197 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-767ab5cc-1a74-4397-a2be-d4f1a66262d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346a9412e0>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:14.367238 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-767ab5cc-1a74-4397-a2be-d4f1a66262d5 None None] Checking router: 3ec8f109-cb75-4f41-81bd-ca78638538c9 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:45:14.376480 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-767ab5cc-1a74-4397-a2be-d4f1a66262d5 None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:14.377097 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-767ab5cc-1a74-4397-a2be-d4f1a66262d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346a9412e0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:14.391202 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-4404cd44-b616-4cc3-8da9-fdb523592012 req-3c6b48b2-a8a9-44f2-9dd5-d9c682fb6d81 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Synchronizing usage tracker for tenant:577d706beb414387a68972cf7e8d0285 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:45:14.411443 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ca54de1d-e9e9-4154-856d-ec5683a7a25e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:14.437141 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-4404cd44-b616-4cc3-8da9-fdb523592012 req-3c6b48b2-a8a9-44f2-9dd5-d9c682fb6d81 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Unset dirty status for tenant:577d706beb414387a68972cf7e8d0285 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:45:14.438337 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4404cd44-b616-4cc3-8da9-fdb523592012 req-3c6b48b2-a8a9-44f2-9dd5-d9c682fb6d81 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9767fed9-aaa7-4205-9878-8d298d4d5801 HTTP/1.1" status: 200  len: 210 time: 0.1031561
May 25 16:45:14.477104 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ca54de1d-e9e9-4154-856d-ec5683a7a25e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:14.481136 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6799a288-0ed9-4ef9-9c99-2443fe513eff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:14.496234 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca54de1d-e9e9-4154-856d-ec5683a7a25e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=409cae44-c363-4438-9964-178dc61344f5,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:14.498808 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ca54de1d-e9e9-4154-856d-ec5683a7a25e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:14.509354 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ca54de1d-e9e9-4154-856d-ec5683a7a25e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:14.510481 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-ca54de1d-e9e9-4154-856d-ec5683a7a25e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "DELETE /v2.0/security-groups/409cae44-c363-4438-9964-178dc61344f5 HTTP/1.1" status: 204  len: 168 time: 0.3090818
May 25 16:45:14.513716 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 60596) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:14.530164 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.api.v2.resource [None req-d2696aa0-8984-46d4-841a-e3b7302e4c70 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] show failed (client error): The resource could not be found.
May 25 16:45:14.534415 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-d2696aa0-8984-46d4-841a-e3b7302e4c70 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "GET /v2.0/security-groups/409cae44-c363-4438-9964-178dc61344f5 HTTP/1.1" status: 404  len: 347 time: 0.0165253
May 25 16:45:14.534625 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 60600) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:14.568496 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-767ab5cc-1a74-4397-a2be-d4f1a66262d5 None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:14.601144 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9767fed9-aaa7-4205-9878-8d298d4d5801', 'name': 'network-vif-deleted', 'tag': '0125dd82-e845-45e1-94c0-4e9afabfecdb'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:45:14.722277 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9767fed9-aaa7-4205-9878-8d298d4d5801', 'name': 'network-vif-deleted', 'tag': '0125dd82-e845-45e1-94c0-4e9afabfecdb', 'status': 'completed', 'code': 200}
May 25 16:45:14.817273 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-69b3bc7e-b6df-4fc8-88e4-76008d21c94f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Deleting port d45be22e-c7ec-4db1-8047-c7a4e9f93476 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:14.817733 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-69b3bc7e-b6df-4fc8-88e4-76008d21c94f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:14.925160 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-767ab5cc-1a74-4397-a2be-d4f1a66262d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346a9412e0>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:14.929248 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-767ab5cc-1a74-4397-a2be-d4f1a66262d5 None None] The sync data for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi is: [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:45:14.946495 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-69b3bc7e-b6df-4fc8-88e4-76008d21c94f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:14.946816 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-69b3bc7e-b6df-4fc8-88e4-76008d21c94f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:15.042390 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 0125dd82-e845-45e1-94c0-4e9afabfecdb no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:15.083611 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 0125dd82-e845-45e1-94c0-4e9afabfecdb {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:15.083963 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 0125dd82-e845-45e1-94c0-4e9afabfecdb not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:15.084386 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 5c47c017-af78-4c20-a79c-f54715856946 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:15.121906 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 5c47c017-af78-4c20-a79c-f54715856946 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:15.122273 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 5c47c017-af78-4c20-a79c-f54715856946 not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:15.164687 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a631bb6f-9f60-451f-b27f-b0e8d9b63971 None None] New status for floating IP 0c27c2b0-a5a4-4301-aeed-262ea696bb1c: DOWN {{(pid=92014) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:45:15.193319 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-69b3bc7e-b6df-4fc8-88e4-76008d21c94f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Calling delete_port for d45be22e-c7ec-4db1-8047-c7a4e9f93476 owned by network:floatingip {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:15.305629 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-69b3bc7e-b6df-4fc8-88e4-76008d21c94f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:15.310509 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:15.384074 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69b3bc7e-b6df-4fc8-88e4-76008d21c94f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Pushing event deleted for resources: {'Port': ['ID=d45be22e-c7ec-4db1-8047-c7a4e9f93476,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:15.386533 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-69b3bc7e-b6df-4fc8-88e4-76008d21c94f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:15.453066 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-69b3bc7e-b6df-4fc8-88e4-76008d21c94f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks [] for floatingip, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:15.474794 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-69b3bc7e-b6df-4fc8-88e4-76008d21c94f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:15.475977 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-69b3bc7e-b6df-4fc8-88e4-76008d21c94f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] 10.222.0.73 "DELETE /v2.0/floatingips/52e4edda-6b53-4831-a933-8fabaef8ff01 HTTP/1.1" status: 204  len: 168 time: 0.9404929
May 25 16:45:15.810229 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-3944d4af-d98e-42ca-8cfd-c8d945f9bf57 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1587326533&fields=id&tenant_id=577d706beb414387a68972cf7e8d0285 HTTP/1.1" status: 200  len: 267 time: 0.0413461
May 25 16:45:15.967421 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-2020f160-f7b4-4a01-b817-c837f2e90314 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:15.968840 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-2020f160-f7b4-4a01-b817-c837f2e90314 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 812 time: 0.1512828
May 25 16:45:15.983729 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-5cc2eb0d-c7dd-4b59-984f-c246d524ddd3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/quotas/577d706beb414387a68972cf7e8d0285 HTTP/1.1" status: 200  len: 375 time: 0.0086515
May 25 16:45:16.069708 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-feef42ff-9df3-42e1-b729-6a5c95a5ef41 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0812628
May 25 16:45:16.205609 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-1221b019-9726-4d44-809d-4a5113cbcb5c service neutron] 10.222.0.73 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1241868
May 25 16:45:16.343725 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-35dc14ca-0f8c-42df-b44c-26ab512eac25 service neutron] 10.222.0.73 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1322339
May 25 16:45:16.742246 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-890686e0-262a-4b4f-bc99-7a2b2c2c8a46 req-d32ad297-2029-48a7-9f1b-7e662e991a04 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 210 time: 0.0484948
May 25 16:45:17.843794 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-643b6eb6-e420-4dff-ad20-47d70fde97f0 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:17.845704 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-643b6eb6-e420-4dff-ad20-47d70fde97f0 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 812 time: 0.1699414
May 25 16:45:17.918162 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7e319408-b239-45e7-a542-b04bc4533a79 req-e25e529d-7d16-48ea-86a4-3d354997c58c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 210 time: 0.0578923
May 25 16:45:17.952627 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-87e9a4df-852a-4924-80a5-dba09e362c65 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=577d706beb414387a68972cf7e8d0285 HTTP/1.1" status: 200  len: 380 time: 0.0589898
May 25 16:45:17.962112 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Request body: {'port': {'device_id': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'admin_state_up': True, 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'security_groups': ['63866e13-b231-485d-a031-21b53f908d39']}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:45:18.112654 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:45:18.121545 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:45:18.131586 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Made reservation on behalf of 577d706beb414387a68972cf7e8d0285 for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:45:18.135146 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:18.306458 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Allocated IP 172.20.0.12 (9c8cc949-bd51-40a0-bff3-5527e7341361/2f2f7850-0dc5-48dc-8602-816147b64784/f34c5bea-0865-4c2c-bcd1-2f43a4456e7f) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:45:18.315150 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 60664) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:18.667622 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:18.708558 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Transition to ACTIVE for port object f34c5bea-0865-4c2c-bcd1-2f43a4456e7f will not be triggered until provisioned by entity DHCP. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:45:18.866459 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:18.878262 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-f7dffedb-2867-49f2-8c3f-1d6ff0b8427e tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:18.965050 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Network 9c8cc949-bd51-40a0-bff3-5527e7341361 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:45:19.018646 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:45:19.028677 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:45:19.072953 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'Port': ['ID=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:19.114083 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.236s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:19.207759 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-76b5d3a1-ac72-4c01-ab40-f504eb17a964 None None] Provisioning for port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:45:19.212885 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-76b5d3a1-ac72-4c01-ab40-f504eb17a964 None None] Provisioning complete for port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:45:19.213260 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-76b5d3a1-ac72-4c01-ab40-f504eb17a964 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:19.217872 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:19.218476 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:19.269793 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-76b5d3a1-ac72-4c01-ab40-f504eb17a964 None None] Port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:45:19.299474 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.3408949
May 25 16:45:19.317563 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c1a35f-13fc-4722-9716-14404446a763 req-3d8838c8-b63b-47c1-a6f4-23d5a425a6b5 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:19.318254 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-f5c1a35f-13fc-4722-9716-14404446a763 req-3d8838c8-b63b-47c1-a6f4-23d5a425a6b5 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Synchronizing usage tracker for tenant:577d706beb414387a68972cf7e8d0285 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:45:19.357234 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-f5c1a35f-13fc-4722-9716-14404446a763 req-3d8838c8-b63b-47c1-a6f4-23d5a425a6b5 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Unset dirty status for tenant:577d706beb414387a68972cf7e8d0285 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:45:19.358389 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f5c1a35f-13fc-4722-9716-14404446a763 req-3d8838c8-b63b-47c1-a6f4-23d5a425a6b5 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 932 time: 0.2954211
May 25 16:45:19.450221 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f5c1a35f-13fc-4722-9716-14404446a763 req-108d83cb-ca91-4620-a90f-c08a4a83f2f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0856156
May 25 16:45:19.468744 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-501288'] for router_interface, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:19.881419 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] Deleting port 102d0170-5098-4810-8f03-423e54159dd7 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:19.882093 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:20.006543 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] For port 102d0170-5098-4810-8f03-423e54159dd7, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=102d0170-5098-4810-8f03-423e54159dd7,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:20.006868 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:20.214730 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] Calling delete_port for 102d0170-5098-4810-8f03-423e54159dd7 owned by network:router_interface {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:20.497256 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:20.501676 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-0c0fe4ff-109b-4c0e-b1f5-f0b75709610c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:20.544733 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] Pushing event deleted for resources: {'Port': ['ID=102d0170-5098-4810-8f03-423e54159dd7,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:20.548340 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:20.800264 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aad3c4e-2384-4c9f-bc0f-868446a9c8fc req-56fea006-8f66-4bb7-813e-c49913c8bdc6 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:20.801647 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2aad3c4e-2384-4c9f-bc0f-868446a9c8fc req-56fea006-8f66-4bb7-813e-c49913c8bdc6 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 932 time: 0.2279325
May 25 16:45:20.917155 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2aad3c4e-2384-4c9f-bc0f-868446a9c8fc req-09d4a649-038c-44a1-91ff-56e781165e66 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0637023
May 25 16:45:20.921165 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1636838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-506040'] for router_interface, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:21.280234 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] Router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:45:21.559535 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:45:21.570867 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9af8f9c8-4a77-4ee3-a19f-f82a0b17f396 None None] Sync routers for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:45:21.572344 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] 10.222.0.73 "PUT /v2.0/routers/c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.2561152
May 25 16:45:21.574924 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60684) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:21.577548 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Request body: {'port': {'device_id': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:45:21.586911 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9af8f9c8-4a77-4ee3-a19f-f82a0b17f396 None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:21.587885 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-9af8f9c8-4a77-4ee3-a19f-f82a0b17f396 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b72da00>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:21.692829 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:21.761112 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Notify callbacks [] for router, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:21.781338 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-9af8f9c8-4a77-4ee3-a19f-f82a0b17f396 None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:21.968999 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:22.049249 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Deleting port 997dcd19-57c4-4c38-a888-8dccf7a26721 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:22.049629 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:22.107871 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f34c5bea-0865-4c2c-bcd1-2f43a4456e7f {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:45:22.118907 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-9af8f9c8-4a77-4ee3-a19f-f82a0b17f396 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b72da00>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132'}], 'enable_snat': True}, 'gw_port_id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:45:20Z', 'revision_number': 5, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port': {'id': '997dcd19-57c4-4c38-a888-8dccf7a26721', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:79:47:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 295, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:38:43Z', 'updated_at': '2021-05-25T16:38:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:22.121607 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:22.123011 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9af8f9c8-4a77-4ee3-a19f-f82a0b17f396 None None] Checking router: c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:45:22.132283 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9af8f9c8-4a77-4ee3-a19f-f82a0b17f396 None None] Routers {'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:22.132885 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-9af8f9c8-4a77-4ee3-a19f-f82a0b17f396 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b72da00>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:22.142859 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Transition to ACTIVE for port object f34c5bea-0865-4c2c-bcd1-2f43a4456e7f will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:45:22.151781 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:22.157002 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-dc08d25b-1fd5-4d5b-93a5-cfd952e714cb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:22.178302 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] For port 997dcd19-57c4-4c38-a888-8dccf7a26721, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=997dcd19-57c4-4c38-a888-8dccf7a26721,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:22.178666 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:22.305858 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-9af8f9c8-4a77-4ee3-a19f-f82a0b17f396 None None] Set router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 gateway port host: None {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:22.306575 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed1aaa0-c5cc-4bc3-82bd-0404873bd490 req-1b853d01-e7e4-4bf3-8c17-9a18b958aaf5 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:22.308391 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4ed1aaa0-c5cc-4bc3-82bd-0404873bd490 req-1b853d01-e7e4-4bf3-8c17-9a18b958aaf5 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 932 time: 0.2531509
May 25 16:45:22.376457 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Pushing event updated for resources: {'Port': ['ID=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:22.378747 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:22.424719 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-9af8f9c8-4a77-4ee3-a19f-f82a0b17f396 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b72da00>, [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:45:21Z', 'revision_number': 6, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port_host': None}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:22.428854 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4ed1aaa0-c5cc-4bc3-82bd-0404873bd490 req-eb995457-f6b6-48df-af8d-388b2256dcfb tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0912774
May 25 16:45:22.428993 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9af8f9c8-4a77-4ee3-a19f-f82a0b17f396 None None] The sync data for ids ['c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7'] in dv-cinder-786386-6-iscsi is: [{'id': 'c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7', 'name': 'tempest-AttachVolumeShelveTestJSON-1820561276-router', 'tenant_id': '9c4a08443867402386f8ec58d2615739', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:38:42Z', 'updated_at': '2021-05-25T16:45:21Z', 'revision_number': 6, 'project_id': '9c4a08443867402386f8ec58d2615739', 'gw_port_host': None}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:45:22.459947 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Calling delete_port for 997dcd19-57c4-4c38-a888-8dccf7a26721 owned by network:router_gateway {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:22.476555 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Attempting to bind port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:45:22.476971 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Attempting to bind port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:45:22.477368 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Attempting to bind port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f on network 9c8cc949-bd51-40a0-bff3-5527e7341361 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:45:22.482107 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f on network 9c8cc949-bd51-40a0-bff3-5527e7341361 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:45:22.482373 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Attempting to bind port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f on network 9c8cc949-bd51-40a0-bff3-5527e7341361 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:45:22.487981 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 45, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:45:22.488316 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Checking segment: {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:45:22.488697 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Bound using segment: {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:45:22.489117 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Bound port: f34c5bea-0865-4c2c-bcd1-2f43a4456e7f, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:45:22.489490 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:22.585060 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] For port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:45:22.588447 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] For port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:45:22.593234 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:22.597699 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-035490d4-6970-40f1-bd54-8bbc5530161c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:22.598573 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:22.603433 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-fd442c93-33f1-4531-8643-2cd7fd6546e7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:22.649050 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Pushing event deleted for resources: {'Port': ['ID=997dcd19-57c4-4c38-a888-8dccf7a26721,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:22.656192 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:22.658156 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:22.658982 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:22.661262 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] 10.222.0.76 "PUT /v2.0/ports/f34c5bea-0865-4c2c-bcd1-2f43a4456e7f HTTP/1.1" status: 200  len: 1094 time: 1.0870912
May 25 16:45:22.661262 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'tag': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:45:22.687987 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Pushing event updated for resources: {'Port': ['ID=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:22.691195 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:22.764144 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-501045'] for router_gateway, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:22.774452 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'tag': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'status': 'completed', 'code': 200}
May 25 16:45:22.862804 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-362236a4-8ac3-4a9b-9991-8ee88d12acc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:22.871481 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-362236a4-8ac3-4a9b-9991-8ee88d12acc7 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 1097 time: 0.1481643
May 25 16:45:22.989084 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-507064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2357'] for router, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:22.991783 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:23.017320 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-507780'] for router, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:23.018066 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 {{(pid=92012) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 16:45:23.021177 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-e6789d32-ecc3-49da-95c4-805ca8048754 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f HTTP/1.1" status: 200  len: 217 time: 0.1408937
May 25 16:45:23.030053 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] Notify callbacks [] for router, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:23.032607 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-95af101c-b2d5-40cb-a353-bd205cd98ae0 admin admin] 10.222.0.73 "DELETE /v2.0/routers/c4d2cd27-c70f-4acc-95e9-40c5ee8e64c7 HTTP/1.1" status: 204  len: 168 time: 1.4552786
May 25 16:45:23.034628 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60698) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:23.091583 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-5cd9ecd6-e48e-4a12-8c01-90ed4a5738ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:23.093009 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-5cd9ecd6-e48e-4a12-8c01-90ed4a5738ab service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.0633113
May 25 16:45:23.095510 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_v2 [None req-329906e3-8720-41e4-939b-dc4f74a2d55d admin admin] Deleting subnet 950695d6-8663-4ed4-92fd-b43d8ea5a820 {{(pid=92012) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:45:23.098602 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-329906e3-8720-41e4-939b-dc4f74a2d55d admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:23.147792 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-329906e3-8720-41e4-939b-dc4f74a2d55d admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-976079'] for subnet, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:23.171059 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-43b0bda1-adbe-47fd-ac25-c54aacf80f9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:23.172630 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-43b0bda1-adbe-47fd-ac25-c54aacf80f9c service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0702939
May 25 16:45:23.229253 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-329906e3-8720-41e4-939b-dc4f74a2d55d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:23.308462 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-06c20e60-ec2b-44b6-8597-35777e5d3fbd service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1275516
May 25 16:45:23.394885 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 102d0170-5098-4810-8f03-423e54159dd7 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:23.433850 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 102d0170-5098-4810-8f03-423e54159dd7 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:23.434430 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 102d0170-5098-4810-8f03-423e54159dd7 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:23.435032 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 997dcd19-57c4-4c38-a888-8dccf7a26721 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:23.476063 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 997dcd19-57c4-4c38-a888-8dccf7a26721 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:23.476441 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 997dcd19-57c4-4c38-a888-8dccf7a26721 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:23.489498 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-329906e3-8720-41e4-939b-dc4f74a2d55d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7721505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-697619'] for subnet, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:23.494331 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-38561a39-2147-4510-8a2f-909adb87de71 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:23.533940 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-329906e3-8720-41e4-939b-dc4f74a2d55d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=950695d6-8663-4ed4-92fd-b43d8ea5a820,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:23.537537 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-329906e3-8720-41e4-939b-dc4f74a2d55d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:23.540450 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6dcd130-7f3b-461b-a041-8ce7f78c8e52 None None] Network b8cabc9a-0f6f-485c-8020-441b42ac019b requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:45:23.540899 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-329906e3-8720-41e4-939b-dc4f74a2d55d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:23.545988 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-329906e3-8720-41e4-939b-dc4f74a2d55d admin admin] 10.222.0.73 "DELETE /v2.0/subnets/950695d6-8663-4ed4-92fd-b43d8ea5a820 HTTP/1.1" status: 204  len: 168 time: 0.5099518
May 25 16:45:23.550038 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60704) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:23.639524 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b0fbc9-e3bd-4ea4-9348-047acfaee54a req-1c2ae748-86a6-4881-98c9-1f59cb705392 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:23.641116 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-07b0fbc9-e3bd-4ea4-9348-047acfaee54a req-1c2ae748-86a6-4881-98c9-1f59cb705392 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 944 time: 0.1046405
May 25 16:45:23.683605 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:23.702709 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-07b0fbc9-e3bd-4ea4-9348-047acfaee54a req-7da5668d-0173-474b-a1a1-16ffef22fb00 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0550840
May 25 16:45:23.771148 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Deleting port e868b405-feac-4de5-a5d6-8583b8ddd553 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:23.771487 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:23.822109 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53089dfb-e702-4fd2-b00a-a6c20798cd0a None None] DHCP port deletion for b8cabc9a-0f6f-485c-8020-441b42ac019b request from dv-cinder-786386-6-iscsi {{(pid=92014) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 16:45:23.875959 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] For port e868b405-feac-4de5-a5d6-8583b8ddd553, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=e868b405-feac-4de5-a5d6-8583b8ddd553,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:23.876370 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:23.890934 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-53089dfb-e702-4fd2-b00a-a6c20798cd0a None None] Deleting port e868b405-feac-4de5-a5d6-8583b8ddd553 {{(pid=92014) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:23.891309 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-53089dfb-e702-4fd2-b00a-a6c20798cd0a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.000474 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-53089dfb-e702-4fd2-b00a-a6c20798cd0a None None] For port e868b405-feac-4de5-a5d6-8583b8ddd553, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=e868b405-feac-4de5-a5d6-8583b8ddd553,segment=NetworkSegment(fc8de9c5-fbec-45ca-854e-a4398e6ac83a),segment_id=fc8de9c5-fbec-45ca-854e-a4398e6ac83a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:24.000879 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-53089dfb-e702-4fd2-b00a-a6c20798cd0a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.107886 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Calling delete_port for e868b405-feac-4de5-a5d6-8583b8ddd553 owned by network:dhcp {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:24.129599 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-53089dfb-e702-4fd2-b00a-a6c20798cd0a None None] Calling delete_port for e868b405-feac-4de5-a5d6-8583b8ddd553 owned by network:dhcp {{(pid=92014) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:24.154273 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.159519 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-07c1a99f-409f-4b46-877f-7dbaec441f99 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:24.176051 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-53089dfb-e702-4fd2-b00a-a6c20798cd0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244'] for port, after_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.179564 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:24.206111 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Pushing event deleted for resources: {'Port': ['ID=e868b405-feac-4de5-a5d6-8583b8ddd553,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:24.209155 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:24.209933 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] No DVR routers for this DVR port e868b405-feac-4de5-a5d6-8583b8ddd553 on host dv-cinder-786386-6-iscsi {{(pid=92012) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:24.221381 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53089dfb-e702-4fd2-b00a-a6c20798cd0a None None] Pushing event deleted for resources: {'Port': ['ID=e868b405-feac-4de5-a5d6-8583b8ddd553,revision_number=None']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:24.225074 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-53089dfb-e702-4fd2-b00a-a6c20798cd0a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:24.227082 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53089dfb-e702-4fd2-b00a-a6c20798cd0a None None] No DVR routers for this DVR port e868b405-feac-4de5-a5d6-8583b8ddd553 on host dv-cinder-786386-6-iscsi {{(pid=92014) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:24.330828 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.345188 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346ab41940>,) {'filters': {'network_id': ['b8cabc9a-0f6f-485c-8020-441b42ac019b']}} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:24.358261 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346ab41940>, 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a') {'for_net_delete': True} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:24.358472 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346ab41940>, 'fc8de9c5-fbec-45ca-854e-a4398e6ac83a') {} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:24.370920 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-976068'] for segment, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.390354 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.396716 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Releasing vlan 414 on physical network physnet1 to pool {{(pid=92012) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:45:24.397101 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7823239'] for segment, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]: Traceback (most recent call last):
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     timer()
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     cb(*args, **kw)
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     return func(*args, **kwargs)
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     self._notify()
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     self.callback(batched_events)
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     event.method(event)
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     return f(self, *a, **k)
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._get(url).json()
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self.request(url, 'GET', **kwargs)
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:45:24.410544 dv-cinder-786386-6-iscsi neutron-server[92012]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:45:24.422960 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-788c4a83-6135-432d-8aa5-b8c7fa082e14 req-f662a2f0-ae57-4722-874d-f602399c18d8 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2244031
May 25 16:45:24.489443 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.492990 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:24.506180 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.516005 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Pushing event deleted for resources: {'Network': ['ID=b8cabc9a-0f6f-485c-8020-441b42ac019b,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:24.519010 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:24.529778 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] 10.222.0.73 "DELETE /v2.0/networks/b8cabc9a-0f6f-485c-8020-441b42ac019b HTTP/1.1" status: 204  len: 168 time: 0.9786663
May 25 16:45:24.645247 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60716) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:24.694270 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-35dbb81d-e160-4799-9fb8-a4eb5afc86d0 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=9c4a08443867402386f8ec58d2615739&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0476193
May 25 16:45:24.696585 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60720) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:24.755181 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7df7f4e1-6fff-4924-98fd-e134c994389b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.780097 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7df7f4e1-6fff-4924-98fd-e134c994389b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.839740 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7df7f4e1-6fff-4924-98fd-e134c994389b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.845055 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-1c3145e2-0ea8-4fce-baae-570162b608ec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:24.859690 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7df7f4e1-6fff-4924-98fd-e134c994389b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18de4288-8c13-4a1e-b2a1-2cc28d575a94,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:24.863000 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7df7f4e1-6fff-4924-98fd-e134c994389b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:24.865268 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-7df7f4e1-6fff-4924-98fd-e134c994389b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:24.869609 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-7df7f4e1-6fff-4924-98fd-e134c994389b admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/18de4288-8c13-4a1e-b2a1-2cc28d575a94 HTTP/1.1" status: 204  len: 168 time: 0.1689446
May 25 16:45:24.894685 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd0aba7-d816-4bb9-8d6f-3df9029c6405 req-bda0a45f-f6fd-4c8f-8ab7-94b8fdfd2519 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:24.896148 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2cd0aba7-d816-4bb9-8d6f-3df9029c6405 req-bda0a45f-f6fd-4c8f-8ab7-94b8fdfd2519 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 944 time: 0.0834761
May 25 16:45:24.941208 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-2cd0aba7-d816-4bb9-8d6f-3df9029c6405 req-b30f1902-5015-4a55-94cd-883ecab60a23 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0394197
May 25 16:45:25.297356 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device e868b405-feac-4de5-a5d6-8583b8ddd553 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:25.334939 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: e868b405-feac-4de5-a5d6-8583b8ddd553 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:25.335297 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device e868b405-feac-4de5-a5d6-8583b8ddd553 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:26.132138 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-531b0d79-e30f-4a91-b826-a155416b9a13 req-67f832b5-bb90-4135-8c7c-e50b7e0889ae tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:26.133741 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-531b0d79-e30f-4a91-b826-a155416b9a13 req-67f832b5-bb90-4135-8c7c-e50b7e0889ae tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 944 time: 0.0867176
May 25 16:45:26.181964 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-531b0d79-e30f-4a91-b826-a155416b9a13 req-d8880677-900d-4c32-a89c-faf829745aae tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421388
May 25 16:45:26.251464 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a63685e3-6a87-441b-8bfb-52d303f108dd req-3471341f-a732-4d5d-adba-003f71bff2ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:26.252851 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a63685e3-6a87-441b-8bfb-52d303f108dd req-3471341f-a732-4d5d-adba-003f71bff2ad service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 1097 time: 0.0697730
May 25 16:45:26.385856 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a63685e3-6a87-441b-8bfb-52d303f108dd req-865a135d-e1a4-4d05-b36a-a306a36439f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:26.387299 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a63685e3-6a87-441b-8bfb-52d303f108dd req-865a135d-e1a4-4d05-b36a-a306a36439f5 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 913 time: 0.1270738
May 25 16:45:26.460009 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a63685e3-6a87-441b-8bfb-52d303f108dd req-1367899b-513d-48af-bd89-c871943c773d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f HTTP/1.1" status: 200  len: 217 time: 0.0650427
May 25 16:45:26.526916 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a63685e3-6a87-441b-8bfb-52d303f108dd req-0018afa9-2d38-4cd0-91ae-57f69c98badd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:26.528290 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a63685e3-6a87-441b-8bfb-52d303f108dd req-0018afa9-2d38-4cd0-91ae-57f69c98badd service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.0611763
May 25 16:45:26.572542 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60772) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:26.621970 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a63685e3-6a87-441b-8bfb-52d303f108dd req-3899a8e5-b457-4cc0-9638-9dce6e8b5cee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:26.623538 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a63685e3-6a87-441b-8bfb-52d303f108dd req-3899a8e5-b457-4cc0-9638-9dce6e8b5cee service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0878012
May 25 16:45:26.698572 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c4c33203-e4f7-44c1-bd60-e9a2dcc43aca admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:26.713812 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c4c33203-e4f7-44c1-bd60-e9a2dcc43aca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:45:26.717567 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c4c33203-e4f7-44c1-bd60-e9a2dcc43aca admin admin] Usage tracker for resource:security_group_rule and tenant:ccecd86b4a6d4d2ab248de5880ef2fe3 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:45:26.721177 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c4c33203-e4f7-44c1-bd60-e9a2dcc43aca admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:45:26.727095 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c4c33203-e4f7-44c1-bd60-e9a2dcc43aca admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:45:26.773577 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b84944ba-46df-4983-aebd-18f38c921f4e req-3f8ad8c3-f047-4b3c-bdc6-808205cbdd91 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1771185305&fields=id&tenant_id=99ba5095326e4a449eb209304e90545f HTTP/1.1" status: 200  len: 267 time: 0.0722990
May 25 16:45:26.811487 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c4c33203-e4f7-44c1-bd60-e9a2dcc43aca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:26.815862 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c4c33203-e4f7-44c1-bd60-e9a2dcc43aca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:26.824385 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-1c4de4ae-cb09-4bba-b464-e4f331c3f684 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:26.841563 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a63685e3-6a87-441b-8bfb-52d303f108dd req-cc6b47da-6a6c-4cf3-8bd4-62df29752665 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2103047
May 25 16:45:26.863233 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c4c33203-e4f7-44c1-bd60-e9a2dcc43aca admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=ccecd86b4a6d4d2ab248de5880ef2fe3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2894931
May 25 16:45:26.864901 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4c33203-e4f7-44c1-bd60-e9a2dcc43aca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56c5ea4e-8dfe-4dee-9302-ac21f820ba5b,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:26.868164 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c4c33203-e4f7-44c1-bd60-e9a2dcc43aca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:26.868803 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60778) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:26.926888 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-06ab1c0c-b41c-40bd-b1bf-e3be99d64c7d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:26.958870 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-06ab1c0c-b41c-40bd-b1bf-e3be99d64c7d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:26.977546 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b84944ba-46df-4983-aebd-18f38c921f4e req-fed1d2d9-f1b3-4753-88f3-5f0c0a044447 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:26.978993 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b84944ba-46df-4983-aebd-18f38c921f4e req-fed1d2d9-f1b3-4753-88f3-5f0c0a044447 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 984 time: 0.1976769
May 25 16:45:26.999787 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-b84944ba-46df-4983-aebd-18f38c921f4e req-476741ef-789a-4992-9e0e-9a65f4216585 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Request body: {'port': {'security_groups': ['87adbc8b-3d4f-4d64-a49b-750ed4406f55']}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:45:27.010585 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-06ab1c0c-b41c-40bd-b1bf-e3be99d64c7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.014337 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f3f1c49d-8e2e-4804-bb4e-ea7c899ce0d5 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:27.029762 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06ab1c0c-b41c-40bd-b1bf-e3be99d64c7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56c5ea4e-8dfe-4dee-9302-ac21f820ba5b,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:27.034768 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-06ab1c0c-b41c-40bd-b1bf-e3be99d64c7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:27.040161 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-06ab1c0c-b41c-40bd-b1bf-e3be99d64c7d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.043843 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-06ab1c0c-b41c-40bd-b1bf-e3be99d64c7d admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/56c5ea4e-8dfe-4dee-9302-ac21f820ba5b HTTP/1.1" status: 204  len: 168 time: 0.1716070
May 25 16:45:27.044003 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a63685e3-6a87-441b-8bfb-52d303f108dd req-cc786905-8060-42a2-b35d-8dd28419ce5f service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1897171
May 25 16:45:27.134425 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b84944ba-46df-4983-aebd-18f38c921f4e req-476741ef-789a-4992-9e0e-9a65f4216585 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.391434 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60794) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:27.431147 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-74421106-e169-4ecc-8650-04c951b76543 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.451294 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-74421106-e169-4ecc-8650-04c951b76543 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:45:27.455072 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-74421106-e169-4ecc-8650-04c951b76543 admin admin] Usage tracker for resource:security_group_rule and tenant:afa92a32f9764fa5a6a02ad52b5a9e50 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:45:27.457936 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-74421106-e169-4ecc-8650-04c951b76543 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:45:27.463731 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-74421106-e169-4ecc-8650-04c951b76543 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:45:27.489331 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-b84944ba-46df-4983-aebd-18f38c921f4e req-476741ef-789a-4992-9e0e-9a65f4216585 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] For port 0266b6be-df05-4348-ad78-3c6b9cb56031, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0266b6be-df05-4348-ad78-3c6b9cb56031,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:27.509637 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-349dad09-c070-4d8d-98f7-8d17451c7f18 req-93c7cf24-6ab2-4d7c-8e71-093a1bf6eaf3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:27.511265 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-349dad09-c070-4d8d-98f7-8d17451c7f18 req-93c7cf24-6ab2-4d7c-8e71-093a1bf6eaf3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 944 time: 0.1730680
May 25 16:45:27.544076 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b84944ba-46df-4983-aebd-18f38c921f4e req-476741ef-789a-4992-9e0e-9a65f4216585 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.547734 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-74421106-e169-4ecc-8650-04c951b76543 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.551413 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b84944ba-46df-4983-aebd-18f38c921f4e req-476741ef-789a-4992-9e0e-9a65f4216585 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.552076 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-74421106-e169-4ecc-8650-04c951b76543 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.561075 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f3e1fa86-9709-4e6d-8750-10d3c61afe2d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:27.563917 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['0266b6be-df05-4348-ad78-3c6b9cb56031'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:45:27.566642 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-2dfb9fd2-8ac2-4f6a-86c8-726cef12dc4b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:27.600597 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74421106-e169-4ecc-8650-04c951b76543 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b8197db5-6e6d-4e86-9368-d096d20d7f32,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:27.605066 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-74421106-e169-4ecc-8650-04c951b76543 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=afa92a32f9764fa5a6a02ad52b5a9e50&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2107861
May 25 16:45:27.606874 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-74421106-e169-4ecc-8650-04c951b76543 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:27.608558 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60798) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:27.609504 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b84944ba-46df-4983-aebd-18f38c921f4e req-476741ef-789a-4992-9e0e-9a65f4216585 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:27.610852 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-b84944ba-46df-4983-aebd-18f38c921f4e req-476741ef-789a-4992-9e0e-9a65f4216585 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.612096 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-b84944ba-46df-4983-aebd-18f38c921f4e req-476741ef-789a-4992-9e0e-9a65f4216585 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "PUT /v2.0/ports/0266b6be-df05-4348-ad78-3c6b9cb56031 HTTP/1.1" status: 200  len: 942 time: 0.6196234
May 25 16:45:27.618688 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:45:27.624344 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60802) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:27.655060 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-349dad09-c070-4d8d-98f7-8d17451c7f18 req-c558f95e-44d3-4ceb-b7c4-1fc82ecae5e3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1300867
May 25 16:45:27.686995 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-476741ef-789a-4992-9e0e-9a65f4216585 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event updated for resources: {'Port': ['ID=0266b6be-df05-4348-ad78-3c6b9cb56031,revision_number=7']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:27.690780 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-476741ef-789a-4992-9e0e-9a65f4216585 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:27.729373 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031', 'status': 'completed', 'code': 200}
May 25 16:45:27.746531 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-679cc475-ea03-48fb-af01-d42f1091bd97 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.784852 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-679cc475-ea03-48fb-af01-d42f1091bd97 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.793240 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2f08ea75-6bc1-4d6f-a571-da2d859a7ffb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.848747 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2f08ea75-6bc1-4d6f-a571-da2d859a7ffb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.902301 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2f08ea75-6bc1-4d6f-a571-da2d859a7ffb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.906229 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7df7f4e1-6fff-4924-98fd-e134c994389b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:27.915609 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-679cc475-ea03-48fb-af01-d42f1091bd97 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.919074 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-fc781b2d-a8f2-4395-ac85-2275ec3a960d None None] Provisioning complete for port 0266b6be-df05-4348-ad78-3c6b9cb56031 triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:45:27.919450 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-fc781b2d-a8f2-4395-ac85-2275ec3a960d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.927108 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f08ea75-6bc1-4d6f-a571-da2d859a7ffb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b8197db5-6e6d-4e86-9368-d096d20d7f32,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:27.929914 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2f08ea75-6bc1-4d6f-a571-da2d859a7ffb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:27.930769 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-5f877f39-e916-46b4-8e91-399fe71e4541 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.007s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:27.955908 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-679cc475-ea03-48fb-af01-d42f1091bd97 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=772f7160-6018-4856-bef5-ffd50932ea20,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:27.959433 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-679cc475-ea03-48fb-af01-d42f1091bd97 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:27.961035 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-2f08ea75-6bc1-4d6f-a571-da2d859a7ffb admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.963875 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-2f08ea75-6bc1-4d6f-a571-da2d859a7ffb admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/b8197db5-6e6d-4e86-9368-d096d20d7f32 HTTP/1.1" status: 204  len: 168 time: 0.3544617
May 25 16:45:27.964851 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-679cc475-ea03-48fb-af01-d42f1091bd97 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:27.966714 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-679cc475-ea03-48fb-af01-d42f1091bd97 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "DELETE /v2.0/security-groups/772f7160-6018-4856-bef5-ffd50932ea20 HTTP/1.1" status: 204  len: 168 time: 0.3411922
May 25 16:45:27.970314 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60810) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:28.247095 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Deleting port b3cf4b67-e312-452e-b653-cf699cccc62c {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:28.247443 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:28.371410 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:28.371751 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:28.621831 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Calling delete_port for b3cf4b67-e312-452e-b653-cf699cccc62c owned by network:floatingip {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:28.701757 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['0266b6be-df05-4348-ad78-3c6b9cb56031'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:45:28.756385 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:28.768397 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-e73a1469-bd7c-4d42-8ea7-1c6c2d4ae74d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:28.866700 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event deleted for resources: {'Port': ['ID=b3cf4b67-e312-452e-b653-cf699cccc62c,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:28.899383 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:28.942378 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks [] for floatingip, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:28.942983 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.l3_db [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Floating IP 7ca10b76-66b9-4a27-9ad6-a462e20dc32d disassociated (deleted). External IP: 172.27.3.214, port: 0266b6be-df05-4348-ad78-3c6b9cb56031.
May 25 16:45:29.033885 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082fbaaf-df49-43f5-85ac-6e986eb212de req-a92d1521-69a8-418c-aac0-20a180066c3f tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:29.035356 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-082fbaaf-df49-43f5-85ac-6e986eb212de req-a92d1521-69a8-418c-aac0-20a180066c3f tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 944 time: 0.2078004
May 25 16:45:29.083827 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-082fbaaf-df49-43f5-85ac-6e986eb212de req-bc640c84-889a-426c-aa78-9e06cdc1d600 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0413957
May 25 16:45:29.323072 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:45:29.504275 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:45:29.517547 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72ad9860-d70d-4471-a2ad-343a308f4bdc None None] Sync routers for ids ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:45:29.527437 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:29.530014 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72ad9860-d70d-4471-a2ad-343a308f4bdc None None] Routers {'eedeb3fa-21be-40a8-bc7a-e35e532db9c4'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:29.531268 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-72ad9860-d70d-4471-a2ad-343a308f4bdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346aced7f0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:29.598813 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-e6d951a2-7a5f-4d56-99f6-25d41ea7208c tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "DELETE /v2.0/floatingips/7ca10b76-66b9-4a27-9ad6-a462e20dc32d HTTP/1.1" status: 204  len: 168 time: 1.6272187
May 25 16:45:29.599567 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:45:29.685790 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031', 'status': 'completed', 'code': 200}
May 25 16:45:29.764994 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-72ad9860-d70d-4471-a2ad-343a308f4bdc None None] Set router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:29.882814 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60868) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:30.020560 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9e74a7de-7501-4dcd-958f-05e74efae231 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:30.037054 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-9e74a7de-7501-4dcd-958f-05e74efae231 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:45:30.041354 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-9e74a7de-7501-4dcd-958f-05e74efae231 admin admin] Usage tracker for resource:security_group_rule and tenant:e491a3c461d04b05a63fc2139bb2e79b is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:45:30.044470 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-9e74a7de-7501-4dcd-958f-05e74efae231 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:45:30.051452 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-9e74a7de-7501-4dcd-958f-05e74efae231 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:45:30.094438 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-72ad9860-d70d-4471-a2ad-343a308f4bdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346aced7f0>, [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97'}], 'enable_snat': True}, 'gw_port_id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:43:08Z', 'revision_number': 4, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port': {'id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:29:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:03Z', 'updated_at': '2021-05-25T16:43:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'dfc3005c-08e6-444a-9b5b-ae177a8dc3e1', 'name': '', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'mac_address': 'fa:16:3e:6d:34:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_interface', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:07Z', 'updated_at': '2021-05-25T16:43:14Z', 'revision_number': 5, 'project_id': '99ba5095326e4a449eb209304e90545f', 'subnets': [{'id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:30.098598 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72ad9860-d70d-4471-a2ad-343a308f4bdc None None] Checking router: eedeb3fa-21be-40a8-bc7a-e35e532db9c4 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:45:30.107212 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72ad9860-d70d-4471-a2ad-343a308f4bdc None None] Routers {'eedeb3fa-21be-40a8-bc7a-e35e532db9c4'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:30.107815 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-72ad9860-d70d-4471-a2ad-343a308f4bdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346aced7f0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:04Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:30.138253 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9e74a7de-7501-4dcd-958f-05e74efae231 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:30.143721 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-9e74a7de-7501-4dcd-958f-05e74efae231 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:30.151492 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-36433aea-96e0-40ae-886a-bb97af265fb6 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:30.193107 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e74a7de-7501-4dcd-958f-05e74efae231 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3e2dbe2-ed82-4ee5-9157-fde404540feb,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:30.197251 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-9e74a7de-7501-4dcd-958f-05e74efae231 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=e491a3c461d04b05a63fc2139bb2e79b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3134177
May 25 16:45:30.198459 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-9e74a7de-7501-4dcd-958f-05e74efae231 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:30.200141 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60878) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:30.266910 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-331d55d8-ab9f-45ac-9bdb-1145513afc72 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:30.293221 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f23cc7d-72cd-441a-85cb-39e4e02d070b req-f7039881-a3f2-49bd-a2c7-310413d940d0 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:30.294818 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9f23cc7d-72cd-441a-85cb-39e4e02d070b req-f7039881-a3f2-49bd-a2c7-310413d940d0 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 944 time: 0.0809903
May 25 16:45:30.295875 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-331d55d8-ab9f-45ac-9bdb-1145513afc72 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:30.309040 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-72ad9860-d70d-4471-a2ad-343a308f4bdc None None] Set router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:30.340615 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9f23cc7d-72cd-441a-85cb-39e4e02d070b req-d01c5da2-ef62-4f67-8ee3-fe2b11321f59 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0398309
May 25 16:45:30.352848 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-331d55d8-ab9f-45ac-9bdb-1145513afc72 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:30.357930 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-77d11e07-ee8d-40b4-a322-946ef0fde79f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:30.370209 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-331d55d8-ab9f-45ac-9bdb-1145513afc72 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3e2dbe2-ed82-4ee5-9157-fde404540feb,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:30.372608 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-331d55d8-ab9f-45ac-9bdb-1145513afc72 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:30.376081 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-331d55d8-ab9f-45ac-9bdb-1145513afc72 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:30.377736 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-331d55d8-ab9f-45ac-9bdb-1145513afc72 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/b3e2dbe2-ed82-4ee5-9157-fde404540feb HTTP/1.1" status: 204  len: 168 time: 0.1765842
May 25 16:45:30.651593 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-72ad9860-d70d-4471-a2ad-343a308f4bdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346aced7f0>, [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97'}], 'enable_snat': True}, 'gw_port_id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:43:08Z', 'revision_number': 4, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port': {'id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:29:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:03Z', 'updated_at': '2021-05-25T16:43:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'dfc3005c-08e6-444a-9b5b-ae177a8dc3e1', 'name': '', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'mac_address': 'fa:16:3e:6d:34:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_interface', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:07Z', 'updated_at': '2021-05-25T16:43:14Z', 'revision_number': 5, 'project_id': '99ba5095326e4a449eb209304e90545f', 'subnets': [{'id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:30.655864 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72ad9860-d70d-4471-a2ad-343a308f4bdc None None] The sync data for ids ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'] in dv-cinder-786386-6-iscsi is: [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97'}], 'enable_snat': True}, 'gw_port_id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:43:08Z', 'revision_number': 4, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port': {'id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:29:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:03Z', 'updated_at': '2021-05-25T16:43:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': 'dfc3005c-08e6-444a-9b5b-ae177a8dc3e1', 'name': '', 'network_id': 'b95afcbb-a35f-4e21-a67d-e6712b2de87f', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'mac_address': 'fa:16:3e:6d:34:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_interface', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:07Z', 'updated_at': '2021-05-25T16:43:14Z', 'revision_number': 5, 'project_id': '99ba5095326e4a449eb209304e90545f', 'subnets': [{'id': '8641bb52-68d1-4215-b71c-1965a76b5e66', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:45:30.666633 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 60888) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:30.686095 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b82f413f-e26e-4086-bafd-7b617d9e9be1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:30.702269 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-b82f413f-e26e-4086-bafd-7b617d9e9be1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:45:30.707026 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-b82f413f-e26e-4086-bafd-7b617d9e9be1 admin admin] Usage tracker for resource:security_group_rule and tenant:4f82c808d07948e1b4c97c923250a0d8 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:45:30.710031 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-b82f413f-e26e-4086-bafd-7b617d9e9be1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:45:30.717152 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-b82f413f-e26e-4086-bafd-7b617d9e9be1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:45:30.745303 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f864d4bb-7dfa-406f-9981-a4934a0b2fc1 req-a473ded8-a958-4a9c-bdc7-5916985da5a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:30.747436 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f864d4bb-7dfa-406f-9981-a4934a0b2fc1 req-a473ded8-a958-4a9c-bdc7-5916985da5a4 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=99ba5095326e4a449eb209304e90545f&device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 1098 time: 0.0881944
May 25 16:45:30.814193 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b82f413f-e26e-4086-bafd-7b617d9e9be1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:30.819632 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b82f413f-e26e-4086-bafd-7b617d9e9be1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:30.829294 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-3986e6da-fd82-4461-8612-0a0a93167633 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:30.873559 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-b82f413f-e26e-4086-bafd-7b617d9e9be1 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=4f82c808d07948e1b4c97c923250a0d8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2058547
May 25 16:45:30.876027 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b82f413f-e26e-4086-bafd-7b617d9e9be1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=afcf6b6f-fdd9-4ca5-879d-43e9027314bc,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:30.877332 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 60892) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:30.879293 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b82f413f-e26e-4086-bafd-7b617d9e9be1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:30.923726 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f864d4bb-7dfa-406f-9981-a4934a0b2fc1 req-b5f17a9c-fc53-4812-8baf-4ea2e1aed792 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:30.925488 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f864d4bb-7dfa-406f-9981-a4934a0b2fc1 req-b5f17a9c-fc53-4812-8baf-4ea2e1aed792 service neutron] 10.222.0.76 "GET /v2.0/networks?id=b95afcbb-a35f-4e21-a67d-e6712b2de87f HTTP/1.1" status: 200  len: 916 time: 0.1689343
May 25 16:45:30.944252 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-996972b3-bec2-42ec-9c13-31d0dabd4d32 None None] New status for floating IP 7ca10b76-66b9-4a27-9ad6-a462e20dc32d: DOWN {{(pid=92015) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:45:31.010754 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f864d4bb-7dfa-406f-9981-a4934a0b2fc1 req-d2b916b2-94c9-40e4-a135-598d25580670 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0266b6be-df05-4348-ad78-3c6b9cb56031 HTTP/1.1" status: 200  len: 217 time: 0.0711334
May 25 16:45:31.060518 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-145b39bd-6168-4688-9b9e-3bc292d5cf53 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:31.100060 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-145b39bd-6168-4688-9b9e-3bc292d5cf53 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:31.112579 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f864d4bb-7dfa-406f-9981-a4934a0b2fc1 req-6093e9b7-785e-4d03-8b5e-9e7d714e6a05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:31.114074 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f864d4bb-7dfa-406f-9981-a4934a0b2fc1 req-6093e9b7-785e-4d03-8b5e-9e7d714e6a05 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=8641bb52-68d1-4215-b71c-1965a76b5e66 HTTP/1.1" status: 200  len: 854 time: 0.0952647
May 25 16:45:31.214540 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f864d4bb-7dfa-406f-9981-a4934a0b2fc1 req-1a00cd1d-9867-4ddc-b742-ec2b2e75e541 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:31.216183 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f864d4bb-7dfa-406f-9981-a4934a0b2fc1 req-1a00cd1d-9867-4ddc-b742-ec2b2e75e541 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b95afcbb-a35f-4e21-a67d-e6712b2de87f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0938027
May 25 16:45:31.220501 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-145b39bd-6168-4688-9b9e-3bc292d5cf53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:31.224165 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-1e4c7803-24f6-48c9-93b3-3f9b8c67631f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:31.255853 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-145b39bd-6168-4688-9b9e-3bc292d5cf53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=afcf6b6f-fdd9-4ca5-879d-43e9027314bc,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:31.261187 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-145b39bd-6168-4688-9b9e-3bc292d5cf53 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:31.317674 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-145b39bd-6168-4688-9b9e-3bc292d5cf53 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:31.318776 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-145b39bd-6168-4688-9b9e-3bc292d5cf53 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/afcf6b6f-fdd9-4ca5-879d-43e9027314bc HTTP/1.1" status: 204  len: 168 time: 0.4402263
May 25 16:45:31.373253 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f864d4bb-7dfa-406f-9981-a4934a0b2fc1 req-26cd017f-00ae-4949-8f9f-99cf439f7dae service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1427269
May 25 16:45:31.433354 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c0dba274-e988-4021-b10e-657fd9f2023d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:31.574799 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-f864d4bb-7dfa-406f-9981-a4934a0b2fc1 req-1932fff6-814f-4e41-ba72-5f8652745ee8 service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1916952
May 25 16:45:31.587231 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a26c0f69-653a-43da-8127-892cdcadd7f9 req-f90cf711-c534-4005-bdf6-0831d39f9ecf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:31.588930 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a26c0f69-653a-43da-8127-892cdcadd7f9 req-f90cf711-c534-4005-bdf6-0831d39f9ecf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 944 time: 0.1300972
May 25 16:45:31.645138 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-a26c0f69-653a-43da-8127-892cdcadd7f9 req-082fcc52-28c4-4a3c-9365-1d63ad4bedb3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0467992
May 25 16:45:31.729994 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39579002-5128-40f7-9c1f-f0130671d876 req-c0e43b64-b6d3-4556-95ae-bbd5612c373f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:31.731826 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39579002-5128-40f7-9c1f-f0130671d876 req-c0e43b64-b6d3-4556-95ae-bbd5612c373f service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=99ba5095326e4a449eb209304e90545f&device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 1098 time: 0.0830791
May 25 16:45:31.868314 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39579002-5128-40f7-9c1f-f0130671d876 req-d8607808-e6f3-4c2c-8e63-057fc2de9ecc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:31.869777 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39579002-5128-40f7-9c1f-f0130671d876 req-d8607808-e6f3-4c2c-8e63-057fc2de9ecc service neutron] 10.222.0.76 "GET /v2.0/networks?id=b95afcbb-a35f-4e21-a67d-e6712b2de87f HTTP/1.1" status: 200  len: 916 time: 0.1314192
May 25 16:45:31.951378 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39579002-5128-40f7-9c1f-f0130671d876 req-92bf336b-b5f3-41aa-87a4-f8f5b79b4e2e service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0266b6be-df05-4348-ad78-3c6b9cb56031 HTTP/1.1" status: 200  len: 217 time: 0.0709476
May 25 16:45:32.027175 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39579002-5128-40f7-9c1f-f0130671d876 req-ea4e9b29-74ec-4f90-b33a-bbd8fcf5fe4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:32.029017 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39579002-5128-40f7-9c1f-f0130671d876 req-ea4e9b29-74ec-4f90-b33a-bbd8fcf5fe4c service neutron] 10.222.0.76 "GET /v2.0/subnets?id=8641bb52-68d1-4215-b71c-1965a76b5e66 HTTP/1.1" status: 200  len: 854 time: 0.0707614
May 25 16:45:32.109451 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39579002-5128-40f7-9c1f-f0130671d876 req-5dbd3616-28e7-4eab-be2d-b4f1f0559d2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:32.110926 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39579002-5128-40f7-9c1f-f0130671d876 req-5dbd3616-28e7-4eab-be2d-b4f1f0559d2a service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b95afcbb-a35f-4e21-a67d-e6712b2de87f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0743215
May 25 16:45:32.262095 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39579002-5128-40f7-9c1f-f0130671d876 req-12c3e579-bc81-4ee0-82a7-bbaf7141de09 service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1434362
May 25 16:45:32.499606 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-39579002-5128-40f7-9c1f-f0130671d876 req-cbda67f0-aca5-43a0-99ff-fa9ec405d771 service neutron] 10.222.0.76 "GET /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2299986
May 25 16:45:32.731986 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device f34c5bea-0865-4c2c-bcd1-2f43a4456e7f details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:45:32.858714 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-710aaea3-ebb1-4ef4-9444-51f80ff3ca6b req-f0c5a704-dcc6-408d-9338-fd440d424c15 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:32.860905 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-710aaea3-ebb1-4ef4-9444-51f80ff3ca6b req-f0c5a704-dcc6-408d-9338-fd440d424c15 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 944 time: 0.1043563
May 25 16:45:32.907256 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:32.911753 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-710aaea3-ebb1-4ef4-9444-51f80ff3ca6b req-d5f5aab2-3d75-452d-9262-33ae0d023af1 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0447500
May 25 16:45:32.924040 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'port_id': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'mac_address': 'fa:16:3e:fe:c5:0b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 435, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:45:32.985772 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:33.003525 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f34c5bea-0865-4c2c-bcd1-2f43a4456e7f {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:45:33.023168 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:33.033576 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:33.034837 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-cd7d475c-68b5-498f-bdb2-2234f121b73d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:33.110265 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:33.113556 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:33.296113 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['f34c5bea-0865-4c2c-bcd1-2f43a4456e7f'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:45:33.734132 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 60996) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:33.844726 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:33.855071 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-eb58f2eb-28a9-4ba7-9c8e-eff8a56a0805 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:33.871075 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-eb58f2eb-28a9-4ba7-9c8e-eff8a56a0805 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:45:33.875773 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-eb58f2eb-28a9-4ba7-9c8e-eff8a56a0805 admin admin] Usage tracker for resource:security_group_rule and tenant:4ff53d3dad694ac682665d15cb519055 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:45:33.879110 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-eb58f2eb-28a9-4ba7-9c8e-eff8a56a0805 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:45:33.885743 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-eb58f2eb-28a9-4ba7-9c8e-eff8a56a0805 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:45:33.979499 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-eb58f2eb-28a9-4ba7-9c8e-eff8a56a0805 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:33.992547 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-eb58f2eb-28a9-4ba7-9c8e-eff8a56a0805 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.032515 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-1f3222eb-5566-4f20-b508-fb5c7e41a0cd tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:34.116431 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7493ccdb-e9c6-4a32-84ae-c70f7ae88d41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.137975 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-eb58f2eb-28a9-4ba7-9c8e-eff8a56a0805 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=4ff53d3dad694ac682665d15cb519055&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4026039
May 25 16:45:34.140776 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 32780) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:34.144917 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb58f2eb-28a9-4ba7-9c8e-eff8a56a0805 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59a928cf-5689-4400-b6a6-ad483073ad3c,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:34.156671 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-eb58f2eb-28a9-4ba7-9c8e-eff8a56a0805 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:34.191635 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49911286-4396-437c-b285-d252edafd7c8 req-eea1a916-9e49-4c01-8159-5f783fb4d632 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:34.193109 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-49911286-4396-437c-b285-d252edafd7c8 req-eea1a916-9e49-4c01-8159-5f783fb4d632 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 945 time: 0.2027965
May 25 16:45:34.205108 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14503f15-5cfe-41b9-9e80-4597b6c8f46b req-dda0e155-211e-4348-8632-ea56b195be71 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:34.205847 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-16e9e59e-8757-488d-a55b-2004ebbcdaf5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.206708 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-14503f15-5cfe-41b9-9e80-4597b6c8f46b req-dda0e155-211e-4348-8632-ea56b195be71 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 945 time: 0.1571121
May 25 16:45:34.233339 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-16e9e59e-8757-488d-a55b-2004ebbcdaf5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.278907 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-49911286-4396-437c-b285-d252edafd7c8 req-c37b7e3f-c263-467d-8117-853475490555 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0711682
May 25 16:45:34.281655 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-14503f15-5cfe-41b9-9e80-4597b6c8f46b req-df474dcf-d503-4d61-ac6c-a38ba8105bfa tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0589910
May 25 16:45:34.291819 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-16e9e59e-8757-488d-a55b-2004ebbcdaf5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.305548 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-6ab14bbd-070a-45f4-8975-a013514379e1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:34.309696 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16e9e59e-8757-488d-a55b-2004ebbcdaf5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59a928cf-5689-4400-b6a6-ad483073ad3c,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:34.312305 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-16e9e59e-8757-488d-a55b-2004ebbcdaf5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:34.320528 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-16e9e59e-8757-488d-a55b-2004ebbcdaf5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.321741 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-16e9e59e-8757-488d-a55b-2004ebbcdaf5 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/59a928cf-5689-4400-b6a6-ad483073ad3c HTTP/1.1" status: 204  len: 168 time: 0.1786866
May 25 16:45:34.597860 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 32788) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:34.616326 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-f0700d5c-3a40-470a-9c39-f9b9a1451e2c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.631436 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-f0700d5c-3a40-470a-9c39-f9b9a1451e2c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:45:34.635201 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-f0700d5c-3a40-470a-9c39-f9b9a1451e2c admin admin] Usage tracker for resource:security_group_rule and tenant:189d5711c84f41c990398eac0630f78c is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:45:34.637969 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-f0700d5c-3a40-470a-9c39-f9b9a1451e2c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:45:34.643604 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-f0700d5c-3a40-470a-9c39-f9b9a1451e2c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:45:34.730966 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-f0700d5c-3a40-470a-9c39-f9b9a1451e2c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.735085 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-f0700d5c-3a40-470a-9c39-f9b9a1451e2c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.741910 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-70823a83-4b1d-4b47-ba6d-e792fd04e5cc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:34.756870 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device f34c5bea-0865-4c2c-bcd1-2f43a4456e7f up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:45:34.783299 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-f0700d5c-3a40-470a-9c39-f9b9a1451e2c admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=189d5711c84f41c990398eac0630f78c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1838400
May 25 16:45:34.784207 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0700d5c-3a40-470a-9c39-f9b9a1451e2c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d954b19-6650-4d13-a1f3-3b3dfc8aa833,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:34.786009 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 32792) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:34.787307 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-f0700d5c-3a40-470a-9c39-f9b9a1451e2c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:34.854576 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-abab64cc-ff85-48e4-aab1-dda6e08f2fb5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.871341 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:45:34.875933 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:45:34.876306 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.880224 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-abab64cc-ff85-48e4-aab1-dda6e08f2fb5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.955085 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-abab64cc-ff85-48e4-aab1-dda6e08f2fb5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.959173 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f5b2945f-2cc8-4367-9726-dac98b78e861 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:34.972512 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abab64cc-ff85-48e4-aab1-dda6e08f2fb5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d954b19-6650-4d13-a1f3-3b3dfc8aa833,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:34.975464 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-abab64cc-ff85-48e4-aab1-dda6e08f2fb5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:34.977502 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-abab64cc-ff85-48e4-aab1-dda6e08f2fb5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:34.981639 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-abab64cc-ff85-48e4-aab1-dda6e08f2fb5 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/1d954b19-6650-4d13-a1f3-3b3dfc8aa833 HTTP/1.1" status: 204  len: 168 time: 0.1899171
May 25 16:45:35.003239 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:35.033191 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:45:35.043328 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:35.048498 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:35.050682 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:35.087631 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'code': 200}
May 25 16:45:35.118385 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:35.133493 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:35.136715 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:35.388351 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dab55b1-c2ec-4f97-92b4-69ad045ebf95 req-abdbde8f-0dcf-40db-885e-b4464cab0277 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:35.390101 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6dab55b1-c2ec-4f97-92b4-69ad045ebf95 req-abdbde8f-0dcf-40db-885e-b4464cab0277 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 1099 time: 0.0766888
May 25 16:45:35.501123 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-6dab55b1-c2ec-4f97-92b4-69ad045ebf95 req-8f0edc3e-26af-4cd3-a5d5-8a25b91707a1 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1014376
May 25 16:45:35.529603 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-110332b5-00e3-48e0-9e38-5cf682bb9208 req-fbce2324-8f2c-422f-b03a-ed828fd24e71 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:35.531176 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-110332b5-00e3-48e0-9e38-5cf682bb9208 req-fbce2324-8f2c-422f-b03a-ed828fd24e71 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 946 time: 0.1147048
May 25 16:45:35.580254 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-110332b5-00e3-48e0-9e38-5cf682bb9208 req-a8c26174-3b1a-4daf-9328-3936fc0d22f5 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429358
May 25 16:45:35.852784 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e0f7d9-63bf-4850-ab5d-e73444ecb7fd req-b78a122d-f4c0-43cb-b6c0-d0107a962a16 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:35.854276 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-31e0f7d9-63bf-4850-ab5d-e73444ecb7fd req-b78a122d-f4c0-43cb-b6c0-d0107a962a16 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 945 time: 0.1619701
May 25 16:45:35.863014 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f66262-f151-4251-a657-44eaaed4b574 req-018caf31-224a-414c-a5bc-7c7597b8fabe tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:35.864379 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-73f66262-f151-4251-a657-44eaaed4b574 req-018caf31-224a-414c-a5bc-7c7597b8fabe tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.76 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 945 time: 0.1097856
May 25 16:45:35.959467 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-31e0f7d9-63bf-4850-ab5d-e73444ecb7fd req-496213b5-db2f-4f33-9851-12046c1e3dc1 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/security-groups?id=87adbc8b-3d4f-4d64-a49b-750ed4406f55&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0931172
May 25 16:45:36.032406 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-73f66262-f151-4251-a657-44eaaed4b574 req-9cdde5a3-bdbd-4277-bdc0-68934b037603 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Deleting port 0266b6be-df05-4348-ad78-3c6b9cb56031 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:36.032671 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-73f66262-f151-4251-a657-44eaaed4b574 req-9cdde5a3-bdbd-4277-bdc0-68934b037603 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:36.189203 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-73f66262-f151-4251-a657-44eaaed4b574 req-9cdde5a3-bdbd-4277-bdc0-68934b037603 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] For port 0266b6be-df05-4348-ad78-3c6b9cb56031, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=0266b6be-df05-4348-ad78-3c6b9cb56031,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:36.189672 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-73f66262-f151-4251-a657-44eaaed4b574 req-9cdde5a3-bdbd-4277-bdc0-68934b037603 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:36.318387 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-73f66262-f151-4251-a657-44eaaed4b574 req-9cdde5a3-bdbd-4277-bdc0-68934b037603 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Calling delete_port for 0266b6be-df05-4348-ad78-3c6b9cb56031 owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:36.455781 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-73f66262-f151-4251-a657-44eaaed4b574 req-9cdde5a3-bdbd-4277-bdc0-68934b037603 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:36.462067 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9cfc642e-03fb-405b-832d-4d6e1951088e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:36.468140 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['0266b6be-df05-4348-ad78-3c6b9cb56031'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:45:36.520857 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cdde5a3-bdbd-4277-bdc0-68934b037603 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Pushing event deleted for resources: {'Port': ['ID=0266b6be-df05-4348-ad78-3c6b9cb56031,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:36.528427 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9cdde5a3-bdbd-4277-bdc0-68934b037603 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:36.589179 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:36.753783 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-73f66262-f151-4251-a657-44eaaed4b574 req-9cdde5a3-bdbd-4277-bdc0-68934b037603 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] No DVR routers for this DVR port 0266b6be-df05-4348-ad78-3c6b9cb56031 on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:36.760423 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-73f66262-f151-4251-a657-44eaaed4b574 req-9cdde5a3-bdbd-4277-bdc0-68934b037603 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:36.763115 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'name': 'network-vif-deleted', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:45:36.813948 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-73f66262-f151-4251-a657-44eaaed4b574 req-9cdde5a3-bdbd-4277-bdc0-68934b037603 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.76 "DELETE /v2.0/ports/0266b6be-df05-4348-ad78-3c6b9cb56031 HTTP/1.1" status: 204  len: 173 time: 0.9336562
May 25 16:45:36.815834 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8e5b2d43-eba5-4097-b5e5-b465a67f06ea', 'name': 'network-vif-deleted', 'tag': '0266b6be-df05-4348-ad78-3c6b9cb56031', 'status': 'completed', 'code': 200}
May 25 16:45:36.852648 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef71c4bd-9de3-40de-ae3d-4f818aa1bcda req-0db78b16-aa89-4a0a-8020-31172e90eb4e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:36.854368 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef71c4bd-9de3-40de-ae3d-4f818aa1bcda req-0db78b16-aa89-4a0a-8020-31172e90eb4e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 946 time: 0.1468205
May 25 16:45:36.919467 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ef71c4bd-9de3-40de-ae3d-4f818aa1bcda req-98000372-a7a5-4072-ad92-48189ade3876 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0557163
May 25 16:45:37.139316 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04ac91a9-35ef-482c-8514-3f8cb07541cd req-1f892a18-98dd-4570-93ce-66afd9928566 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:37.141422 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-04ac91a9-35ef-482c-8514-3f8cb07541cd req-1f892a18-98dd-4570-93ce-66afd9928566 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 946 time: 0.1006753
May 25 16:45:37.190371 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-04ac91a9-35ef-482c-8514-3f8cb07541cd req-b58a5709-4690-45da-b9be-131bff79883d tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430455
May 25 16:45:37.218263 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 32866) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:37.282771 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-704c4650-e185-47c1-b7f9-ed54e07372ab req-728c9bd6-d9f8-4ce1-b264-da9da2df28cd tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Synchronizing usage tracker for tenant:99ba5095326e4a449eb209304e90545f on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:45:37.302858 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-704c4650-e185-47c1-b7f9-ed54e07372ab req-728c9bd6-d9f8-4ce1-b264-da9da2df28cd tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Unset dirty status for tenant:99ba5095326e4a449eb209304e90545f on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:45:37.311704 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-704c4650-e185-47c1-b7f9-ed54e07372ab req-728c9bd6-d9f8-4ce1-b264-da9da2df28cd tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] 10.222.0.73 "GET /v2.0/ports?device_id=8e5b2d43-eba5-4097-b5e5-b465a67f06ea HTTP/1.1" status: 200  len: 210 time: 0.0842097
May 25 16:45:37.375903 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6607266b-d3ef-409b-9f47-fd135de4ff21 tempest-TestVolumeBootPattern-836350970 tempest-TestVolumeBootPattern-836350970-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92012) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:37.376622 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-6607266b-d3ef-409b-9f47-fd135de4ff21 tempest-TestVolumeBootPattern-836350970 tempest-TestVolumeBootPattern-836350970-project-admin] Synchronizing usage tracker for tenant:d0bf591a76874ca3957c9de33c471227 on resource:port {{(pid=92012) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:45:37.394764 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-6607266b-d3ef-409b-9f47-fd135de4ff21 tempest-TestVolumeBootPattern-836350970 tempest-TestVolumeBootPattern-836350970-project-admin] Unset dirty status for tenant:d0bf591a76874ca3957c9de33c471227 on resource:port {{(pid=92012) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:45:37.397873 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-6607266b-d3ef-409b-9f47-fd135de4ff21 tempest-TestVolumeBootPattern-836350970 tempest-TestVolumeBootPattern-836350970-project-admin] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 1094 time: 0.1772358
May 25 16:45:37.398749 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 32874) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:37.403978 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.v2.base [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Request body: {'floatingip': {'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'port_id': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address': '172.20.0.12'}} {{(pid=92012) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:45:37.410648 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:45:37.414452 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Usage tracker for resource:floatingip and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:45:37.417284 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:45:37.423819 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:45:37.436294 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for floatingip, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:37.463986 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa4ca9b9-abf6-4ec3-86b4-fc650c18a16f req-ad02d704-06bc-4f2f-ac40-583639bdb81c tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:37.465653 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fa4ca9b9-abf6-4ec3-86b4-fc650c18a16f req-ad02d704-06bc-4f2f-ac40-583639bdb81c tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 946 time: 0.0881193
May 25 16:45:37.516604 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fa4ca9b9-abf6-4ec3-86b4-fc650c18a16f req-21ae9b68-9cd5-4c83-a778-d4ccd6af5182 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0446668
May 25 16:45:37.683356 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:37.820238 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_common [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Allocated IP 172.27.3.238 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/70ebe568-64ee-4e64-8261-c10615c9ac85) {{(pid=92012) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:45:37.965569 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for port, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:37.995882 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:38.000323 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7bf0bc36-6007-49d7-90a4-70f7103490a1 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:38.071045 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92012) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:45:38.073878 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.base_scheduler [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources bound (agent type, host, resource id):  {{(pid=92012) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:45:38.082414 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Received port after_create {{(pid=92012) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:45:38.116969 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'Port': ['ID=70ebe568-64ee-4e64-8261-c10615c9ac85,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:38.120997 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:38.512784 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:38.608909 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:38.777746 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 0266b6be-df05-4348-ad78-3c6b9cb56031 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:38.781791 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0594b5ee-ec2c-48f1-8a63-a08908b934f4 req-7617e0e4-116f-4431-89f6-5481e3e97f9b tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:38.783690 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0594b5ee-ec2c-48f1-8a63-a08908b934f4 req-7617e0e4-116f-4431-89f6-5481e3e97f9b tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 946 time: 0.1397429
May 25 16:45:38.863601 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for port, precommit_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:38.872224 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7823323'] for port, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:38.875422 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 0266b6be-df05-4348-ad78-3c6b9cb56031 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:38.875980 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 0266b6be-df05-4348-ad78-3c6b9cb56031 not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:38.880538 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-42979c3a-f4d2-42b3-8a16-59bee406fc7c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:38.883778 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0594b5ee-ec2c-48f1-8a63-a08908b934f4 req-f35803d9-4011-49c4-b58b-b17c9205ddd7 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0880013
May 25 16:45:38.910513 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b2eb1d-3c34-4410-b0ab-34c3c32ccac0 req-4b72d805-d219-43dd-8bd5-0bb3e16b009a tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:38.912099 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-61b2eb1d-3c34-4410-b0ab-34c3c32ccac0 req-4b72d805-d219-43dd-8bd5-0bb3e16b009a tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.76 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 946 time: 0.1845524
May 25 16:45:39.007708 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'Port': ['ID=70ebe568-64ee-4e64-8261-c10615c9ac85,revision_number=2']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:39.011175 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:39.018660 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:39.103576 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-61b2eb1d-3c34-4410-b0ab-34c3c32ccac0 req-495f4f2f-f572-4c08-8116-b808e8ba8105 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Deleting port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:39.104392 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-61b2eb1d-3c34-4410-b0ab-34c3c32ccac0 req-495f4f2f-f572-4c08-8116-b808e8ba8105 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:39.231010 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.l3_db [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Floating IP c671a6ec-38d9-408e-bfd3-14267b94e234 associated. External IP: 172.27.3.238, port: f34c5bea-0865-4c2c-bcd1-2f43a4456e7f.
May 25 16:45:39.259044 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-61b2eb1d-3c34-4410-b0ab-34c3c32ccac0 req-495f4f2f-f572-4c08-8116-b808e8ba8105 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] For port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d,segment=NetworkSegment(24e045d0-637a-4a9d-af18-175fe9d4147a),segment_id=24e045d0-637a-4a9d-af18-175fe9d4147a)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:39.262691 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-61b2eb1d-3c34-4410-b0ab-34c3c32ccac0 req-495f4f2f-f572-4c08-8116-b808e8ba8105 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:39.273785 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 32936) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:39.463986 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-61b2eb1d-3c34-4410-b0ab-34c3c32ccac0 req-495f4f2f-f572-4c08-8116-b808e8ba8105 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Calling delete_port for cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:39.695944 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Router 3ec8f109-cb75-4f41-81bd-ca78638538c9 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:45:39.862319 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-61b2eb1d-3c34-4410-b0ab-34c3c32ccac0 req-495f4f2f-f572-4c08-8116-b808e8ba8105 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:39.885886 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:45:39.895616 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d1ebd2b-aeea-48a0-9533-01a6dfdfe24d None None] Sync routers for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:45:39.906113 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d1ebd2b-aeea-48a0-9533-01a6dfdfe24d None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:39.907332 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-6d1ebd2b-aeea-48a0-9533-01a6dfdfe24d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b7a59d0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:39.913648 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:39.967694 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ad3ba46c-4d03-49d2-80b0-cab88e8eb33c tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:39.991180 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-65d6f40b-3c32-4f94-bcf0-9ac8d0fe14af tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.5913432
May 25 16:45:39.991975 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'tag': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:45:40.017485 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-495f4f2f-f572-4c08-8116-b808e8ba8105 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Pushing event deleted for resources: {'Port': ['ID=cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:40.022903 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-495f4f2f-f572-4c08-8116-b808e8ba8105 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:40.044273 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'tag': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'status': 'completed', 'code': 200}
May 25 16:45:40.104364 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-6d1ebd2b-aeea-48a0-9533-01a6dfdfe24d None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:40.143617 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3dde2685-9862-4aba-addd-a16f84847663 req-0ce6457d-e2a2-4f60-adc3-a8b321421b46 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 210 time: 0.0914435
May 25 16:45:40.221958 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-61b2eb1d-3c34-4410-b0ab-34c3c32ccac0 req-495f4f2f-f572-4c08-8116-b808e8ba8105 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] No DVR routers for this DVR port cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:40.234827 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-61b2eb1d-3c34-4410-b0ab-34c3c32ccac0 req-495f4f2f-f572-4c08-8116-b808e8ba8105 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:40.238122 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8014a243-8f63-40f1-95b7-9200f8a73636', 'name': 'network-vif-deleted', 'tag': 'cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:45:40.268454 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-61b2eb1d-3c34-4410-b0ab-34c3c32ccac0 req-495f4f2f-f572-4c08-8116-b808e8ba8105 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.76 "DELETE /v2.0/ports/cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d HTTP/1.1" status: 204  len: 173 time: 1.3504565
May 25 16:45:40.290680 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316bfd6a-50b9-4166-ab03-2906b099d0bd req-2c9963f0-ad9d-4bc5-a3db-f31a6f65151e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:40.292153 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-316bfd6a-50b9-4166-ab03-2906b099d0bd req-2c9963f0-ad9d-4bc5-a3db-f31a6f65151e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 1099 time: 0.2007670
May 25 16:45:40.322008 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8014a243-8f63-40f1-95b7-9200f8a73636', 'name': 'network-vif-deleted', 'tag': 'cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d', 'status': 'completed', 'code': 200}
May 25 16:45:40.504444 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316bfd6a-50b9-4166-ab03-2906b099d0bd req-bdd54d7b-abfb-4ee1-9348-11547aeb262f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:40.506213 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-316bfd6a-50b9-4166-ab03-2906b099d0bd req-bdd54d7b-abfb-4ee1-9348-11547aeb262f service neutron] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 913 time: 0.2056932
May 25 16:45:40.515448 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-6d1ebd2b-aeea-48a0-9533-01a6dfdfe24d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b7a59d0>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': 'c671a6ec-38d9-408e-bfd3-14267b94e234', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.238', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 663, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:fe:c5:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:45:38Z', 'updated_at': '2021-05-25T16:45:38Z', 'revision_number': 0, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:40.520178 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-501288'] for router_interface, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:40.520327 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d1ebd2b-aeea-48a0-9533-01a6dfdfe24d None None] Checking router: 3ec8f109-cb75-4f41-81bd-ca78638538c9 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:45:40.528991 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d1ebd2b-aeea-48a0-9533-01a6dfdfe24d None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:40.529637 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-6d1ebd2b-aeea-48a0-9533-01a6dfdfe24d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b7a59d0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:40.787345 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-316bfd6a-50b9-4166-ab03-2906b099d0bd req-7a30b8df-2655-4dff-a88c-9f2165ecc1e9 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f HTTP/1.1" status: 200  len: 1000 time: 0.2075627
May 25 16:45:40.803966 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:40.890963 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-6d1ebd2b-aeea-48a0-9533-01a6dfdfe24d None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:40.975810 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316bfd6a-50b9-4166-ab03-2906b099d0bd req-9c5aeb08-3f2c-4e28-8c06-d0269d1cb95d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:40.977230 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-316bfd6a-50b9-4166-ab03-2906b099d0bd req-9c5aeb08-3f2c-4e28-8c06-d0269d1cb95d service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.1782799
May 25 16:45:40.995874 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:40.996470 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device cdaf2f90-6e47-475d-9b44-6aa12eb0ef2d not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:41.154668 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316bfd6a-50b9-4166-ab03-2906b099d0bd req-a9b6eb75-d39c-498b-9226-e535a941045b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:41.163106 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-316bfd6a-50b9-4166-ab03-2906b099d0bd req-a9b6eb75-d39c-498b-9226-e535a941045b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1742949
May 25 16:45:41.325117 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] Deleting port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:41.325494 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:41.457138 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-6d1ebd2b-aeea-48a0-9533-01a6dfdfe24d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b7a59d0>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': 'c671a6ec-38d9-408e-bfd3-14267b94e234', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.238', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 663, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:fe:c5:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:45:38Z', 'updated_at': '2021-05-25T16:45:38Z', 'revision_number': 0, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:41.462329 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d1ebd2b-aeea-48a0-9533-01a6dfdfe24d None None] The sync data for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi is: [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': 'c671a6ec-38d9-408e-bfd3-14267b94e234', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.238', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 663, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:fe:c5:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:45:38Z', 'updated_at': '2021-05-25T16:45:38Z', 'revision_number': 0, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:45:41.550925 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-d6e7d397-5f49-41c2-9e6e-8a909d36f78c req-49248026-9836-47bc-a7fa-499668b206c2 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Synchronizing usage tracker for tenant:a08b794404294bb48dc9c4982f9bfecb on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:45:41.591966 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-316bfd6a-50b9-4166-ab03-2906b099d0bd req-34369b0d-8351-42ee-ac4c-78230e7f4fea service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4151311
May 25 16:45:41.624850 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-d6e7d397-5f49-41c2-9e6e-8a909d36f78c req-49248026-9836-47bc-a7fa-499668b206c2 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Unset dirty status for tenant:a08b794404294bb48dc9c4982f9bfecb on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:45:41.626539 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d6e7d397-5f49-41c2-9e6e-8a909d36f78c req-49248026-9836-47bc-a7fa-499668b206c2 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=8014a243-8f63-40f1-95b7-9200f8a73636 HTTP/1.1" status: 200  len: 210 time: 0.2857599
May 25 16:45:41.661780 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c87a4379-4fe6-4ad2-b9d5-f5ae29bb2067 None None] New status for floating IP c671a6ec-38d9-408e-bfd3-14267b94e234: ACTIVE {{(pid=92015) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:45:41.719116 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] For port dfc3005c-08e6-444a-9b5b-ae177a8dc3e1, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=dfc3005c-08e6-444a-9b5b-ae177a8dc3e1,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:41.719992 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:41.859566 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] Calling delete_port for dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 owned by network:router_interface {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:41.889462 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-316bfd6a-50b9-4166-ab03-2906b099d0bd req-66000153-b33b-45af-accb-6fa87294d2ad service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2857213
May 25 16:45:42.041163 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:42.045781 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d959b2de-34dd-45e3-a3b3-1065bca9de1d tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:42.092754 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] Pushing event deleted for resources: {'Port': ['ID=dfc3005c-08e6-444a-9b5b-ae177a8dc3e1,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:42.095208 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:42.374357 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1636838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-506040'] for router_interface, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:42.751303 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] Router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:45:42.934932 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:45:42.944615 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9923da4-f05e-434d-9661-127bd41ead57 None None] Sync routers for ids ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:45:42.951003 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] 10.222.0.73 "PUT /v2.0/routers/eedeb3fa-21be-40a8-bc7a-e35e532db9c4/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.6730552
May 25 16:45:42.953619 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 32978) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:42.957243 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9923da4-f05e-434d-9661-127bd41ead57 None None] Routers {'eedeb3fa-21be-40a8-bc7a-e35e532db9c4'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:42.958061 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-e9923da4-f05e-434d-9661-127bd41ead57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b5d77f0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:43.144697 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Notify callbacks [] for router, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:43.160316 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-e9923da4-f05e-434d-9661-127bd41ead57 None None] Set router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:43.322561 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:43.398849 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Deleting port 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:43.399190 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:43.474738 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-e9923da4-f05e-434d-9661-127bd41ead57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b5d77f0>, [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97'}], 'enable_snat': True}, 'gw_port_id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:45:41Z', 'revision_number': 5, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port': {'id': '7734ff45-2516-4b7e-bd97-3e1c727bd6b1', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:29:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:03Z', 'updated_at': '2021-05-25T16:43:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:43.478886 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9923da4-f05e-434d-9661-127bd41ead57 None None] Checking router: eedeb3fa-21be-40a8-bc7a-e35e532db9c4 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:45:43.488167 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9923da4-f05e-434d-9661-127bd41ead57 None None] Routers {'eedeb3fa-21be-40a8-bc7a-e35e532db9c4'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:43.488797 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-e9923da4-f05e-434d-9661-127bd41ead57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b5d77f0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:43.526896 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] For port 7734ff45-2516-4b7e-bd97-3e1c727bd6b1, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=7734ff45-2516-4b7e-bd97-3e1c727bd6b1,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:43.527164 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:43.641685 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-e9923da4-f05e-434d-9661-127bd41ead57 None None] Set router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 gateway port host: None {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:43.650969 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Calling delete_port for 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 owned by network:router_gateway {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:43.766217 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-e9923da4-f05e-434d-9661-127bd41ead57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b5d77f0>, [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:45:43Z', 'revision_number': 6, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port_host': None}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:43.774499 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9923da4-f05e-434d-9661-127bd41ead57 None None] The sync data for ids ['eedeb3fa-21be-40a8-bc7a-e35e532db9c4'] in dv-cinder-786386-6-iscsi is: [{'id': 'eedeb3fa-21be-40a8-bc7a-e35e532db9c4', 'name': 'tempest-TestMinimumBasicScenario-2100473491-router', 'tenant_id': '99ba5095326e4a449eb209304e90545f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:02Z', 'updated_at': '2021-05-25T16:45:43Z', 'revision_number': 6, 'project_id': '99ba5095326e4a449eb209304e90545f', 'gw_port_host': None}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:45:43.927010 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:43.930705 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-7ae182f1-0b06-4509-a175-3dd8078cad23 tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:43.974365 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Pushing event deleted for resources: {'Port': ['ID=7734ff45-2516-4b7e-bd97-3e1c727bd6b1,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:43.977501 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:44.075921 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-501045'] for router_gateway, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:44.222620 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:44.264522 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-507064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2357'] for router, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:44.267341 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:44.291710 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-507780'] for router, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:44.292513 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router eedeb3fa-21be-40a8-bc7a-e35e532db9c4 {{(pid=92012) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 16:45:44.307862 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] Notify callbacks [] for router, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:44.308953 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-20faf354-2fe1-4ba6-9307-56600189fbe0 admin admin] 10.222.0.73 "DELETE /v2.0/routers/eedeb3fa-21be-40a8-bc7a-e35e532db9c4 HTTP/1.1" status: 204  len: 168 time: 1.3543665
May 25 16:45:44.311586 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 32996) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:44.369445 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.db_base_plugin_v2 [None req-c7669f62-7245-4a0d-b38f-f7667deaeb26 admin admin] Deleting subnet 8641bb52-68d1-4215-b71c-1965a76b5e66 {{(pid=92012) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:45:44.372244 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c7669f62-7245-4a0d-b38f-f7667deaeb26 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:44.424054 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c7669f62-7245-4a0d-b38f-f7667deaeb26 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-976079'] for subnet, precommit_delete_associations {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:44.510368 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c7669f62-7245-4a0d-b38f-f7667deaeb26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:44.766150 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c7669f62-7245-4a0d-b38f-f7667deaeb26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7721505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-697619'] for subnet, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:44.770680 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-329906e3-8720-41e4-939b-dc4f74a2d55d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:44.810860 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7669f62-7245-4a0d-b38f-f7667deaeb26 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8641bb52-68d1-4215-b71c-1965a76b5e66,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:44.814665 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c7669f62-7245-4a0d-b38f-f7667deaeb26 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:44.815577 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c7669f62-7245-4a0d-b38f-f7667deaeb26 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for subnet, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:44.823642 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5df73465-2e30-4110-8a9b-0ee2d7d9e635 None None] Network b95afcbb-a35f-4e21-a67d-e6712b2de87f requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:45:44.824415 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33000) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:44.825911 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c7669f62-7245-4a0d-b38f-f7667deaeb26 admin admin] 10.222.0.73 "DELETE /v2.0/subnets/8641bb52-68d1-4215-b71c-1965a76b5e66 HTTP/1.1" status: 204  len: 168 time: 0.5092578
May 25 16:45:45.034565 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:45.078072 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d4bc3aa-7f0c-46f4-b37a-81ee83dda1a0 None None] DHCP port deletion for b95afcbb-a35f-4e21-a67d-e6712b2de87f request from dv-cinder-786386-6-iscsi {{(pid=92014) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 16:45:45.127123 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Deleting port 4409a694-0319-4856-8e61-a5629373a62e {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:45.127492 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:45.175212 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-4d4bc3aa-7f0c-46f4-b37a-81ee83dda1a0 None None] Deleting port 4409a694-0319-4856-8e61-a5629373a62e {{(pid=92014) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:45.175379 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4d4bc3aa-7f0c-46f4-b37a-81ee83dda1a0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:45.246077 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] For port 4409a694-0319-4856-8e61-a5629373a62e, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=4409a694-0319-4856-8e61-a5629373a62e,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:45.246433 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:45.277676 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-4d4bc3aa-7f0c-46f4-b37a-81ee83dda1a0 None None] For port 4409a694-0319-4856-8e61-a5629373a62e, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=4409a694-0319-4856-8e61-a5629373a62e,segment=NetworkSegment(2de50154-f13b-406e-b119-a40fe0f3910b),segment_id=2de50154-f13b-406e-b119-a40fe0f3910b)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:45.278175 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4d4bc3aa-7f0c-46f4-b37a-81ee83dda1a0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:45.339842 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:45.371287 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Calling delete_port for 4409a694-0319-4856-8e61-a5629373a62e owned by network:dhcp {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:45.419664 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:45.423561 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-46c84f07-0858-4124-ad23-1203fe719175 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:45.471374 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Pushing event deleted for resources: {'Port': ['ID=4409a694-0319-4856-8e61-a5629373a62e,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:45.473856 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] No DVR routers for this DVR port 4409a694-0319-4856-8e61-a5629373a62e on host dv-cinder-786386-6-iscsi {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:45.475946 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:45.479200 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-4d4bc3aa-7f0c-46f4-b37a-81ee83dda1a0 None None] Calling delete_port for 4409a694-0319-4856-8e61-a5629373a62e owned by network:dhcp {{(pid=92014) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:45.481921 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:45.482266 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 7734ff45-2516-4b7e-bd97-3e1c727bd6b1 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:45.482675 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:45.520290 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:45.520638 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device dfc3005c-08e6-444a-9b5b-ae177a8dc3e1 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:45.521295 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 4409a694-0319-4856-8e61-a5629373a62e no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:45.561595 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 4409a694-0319-4856-8e61-a5629373a62e {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:45.561948 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 4409a694-0319-4856-8e61-a5629373a62e not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:45.590819 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:45.591537 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4d4bc3aa-7f0c-46f4-b37a-81ee83dda1a0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244'] for port, after_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:45.595201 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:45.603770 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346b1dc250>,) {'filters': {'network_id': ['b95afcbb-a35f-4e21-a67d-e6712b2de87f']}} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:45.616242 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b1dc250>, '2de50154-f13b-406e-b119-a40fe0f3910b') {'for_net_delete': True} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:45.616543 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b1dc250>, '2de50154-f13b-406e-b119-a40fe0f3910b') {} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:45.628425 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6928871'] for segment, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:45.642283 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d4bc3aa-7f0c-46f4-b37a-81ee83dda1a0 None None] No DVR routers for this DVR port 4409a694-0319-4856-8e61-a5629373a62e on host dv-cinder-786386-6-iscsi {{(pid=92014) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:45.643767 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d4bc3aa-7f0c-46f4-b37a-81ee83dda1a0 None None] Pushing event deleted for resources: {'Port': ['ID=4409a694-0319-4856-8e61-a5629373a62e,revision_number=None']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:45.645828 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:45.646551 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-4d4bc3aa-7f0c-46f4-b37a-81ee83dda1a0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:45.652937 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Releasing vlan 432 on physical network physnet1 to pool {{(pid=92013) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:45:45.653335 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7025874'] for segment, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]: Traceback (most recent call last):
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     timer()
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     cb(*args, **kw)
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     return func(*args, **kwargs)
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     self._notify()
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     self.callback(batched_events)
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     event.method(event)
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     return f(self, *a, **k)
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self._get(url).json()
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self.request(url, 'GET', **kwargs)
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:45:45.666790 dv-cinder-786386-6-iscsi neutron-server[92013]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:45:45.743266 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:45.747146 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:45.760623 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:45.771172 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Pushing event deleted for resources: {'Network': ['ID=b95afcbb-a35f-4e21-a67d-e6712b2de87f,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:45.775168 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:45.778593 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] 10.222.0.73 "DELETE /v2.0/networks/b95afcbb-a35f-4e21-a67d-e6712b2de87f HTTP/1.1" status: 204  len: 168 time: 0.9531596
May 25 16:45:45.781552 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33008) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:46.336373 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-388ad08b-b800-4516-8323-141430c2e4a6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-501288'] for router_interface, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:46.854622 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-388ad08b-b800-4516-8323-141430c2e4a6 admin admin] Deleting port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:46.854849 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-388ad08b-b800-4516-8323-141430c2e4a6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:46.977024 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [None req-388ad08b-b800-4516-8323-141430c2e4a6 admin admin] For port 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=39dbdfc1-4a8f-4ab3-b86d-c5113b292e19,segment=NetworkSegment(6f2fbde7-1734-4509-9381-f214bf3ae61a),segment_id=6f2fbde7-1734-4509-9381-f214bf3ae61a)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:46.977379 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-388ad08b-b800-4516-8323-141430c2e4a6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:47.099073 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-388ad08b-b800-4516-8323-141430c2e4a6 admin admin] Calling delete_port for 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 owned by network:router_interface {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:47.247814 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-388ad08b-b800-4516-8323-141430c2e4a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:47.254088 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-49923ba9-9e55-4b5f-ad45-5e7425f49353 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:47.297303 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-388ad08b-b800-4516-8323-141430c2e4a6 admin admin] Pushing event deleted for resources: {'Port': ['ID=39dbdfc1-4a8f-4ab3-b86d-c5113b292e19,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:47.300524 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-388ad08b-b800-4516-8323-141430c2e4a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:47.598803 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-388ad08b-b800-4516-8323-141430c2e4a6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1636838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-506040'] for router_interface, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:48.068146 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-388ad08b-b800-4516-8323-141430c2e4a6 admin admin] Router 1eb7a247-2042-41e7-b3b1-d7975f120426 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:45:48.252003 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-388ad08b-b800-4516-8323-141430c2e4a6 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:45:48.260292 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f527d37-8a45-4909-9774-48eabe6f9c1d None None] Sync routers for ids ['1eb7a247-2042-41e7-b3b1-d7975f120426'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:45:48.260808 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-388ad08b-b800-4516-8323-141430c2e4a6 admin admin] 10.222.0.73 "PUT /v2.0/routers/1eb7a247-2042-41e7-b3b1-d7975f120426/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4782636
May 25 16:45:48.263314 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33038) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:48.270260 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f527d37-8a45-4909-9774-48eabe6f9c1d None None] Routers {'1eb7a247-2042-41e7-b3b1-d7975f120426'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:48.270862 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-3f527d37-8a45-4909-9774-48eabe6f9c1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b934c70>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['1eb7a247-2042-41e7-b3b1-d7975f120426'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:48.441337 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Notify callbacks [] for router, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:48.445953 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-3f527d37-8a45-4909-9774-48eabe6f9c1d None None] Set router 1eb7a247-2042-41e7-b3b1-d7975f120426 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:48.636147 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:48.725245 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Deleting port 41dcd114-5772-4f32-89f2-074fba0becbc {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:48.725604 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:48.802836 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-3f527d37-8a45-4909-9774-48eabe6f9c1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b934c70>, [{'id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'name': 'tempest-TestMinimumBasicScenario-1021459048-router', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223'}], 'enable_snat': True}, 'gw_port_id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:12Z', 'updated_at': '2021-05-25T16:45:47Z', 'revision_number': 5, 'project_id': '23d514b2a6d54d9780353478bc32379c', 'gw_port': {'id': '41dcd114-5772-4f32-89f2-074fba0becbc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:2d:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'device_owner': 'network:router_gateway', 'standard_attr_id': 573, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:43:13Z', 'updated_at': '2021-05-25T16:43:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:48.807839 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f527d37-8a45-4909-9774-48eabe6f9c1d None None] Checking router: 1eb7a247-2042-41e7-b3b1-d7975f120426 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:45:48.818707 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f527d37-8a45-4909-9774-48eabe6f9c1d None None] Routers {'1eb7a247-2042-41e7-b3b1-d7975f120426'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:45:48.819463 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-3f527d37-8a45-4909-9774-48eabe6f9c1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b934c70>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:45:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['1eb7a247-2042-41e7-b3b1-d7975f120426'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:48.874597 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] For port 41dcd114-5772-4f32-89f2-074fba0becbc, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=41dcd114-5772-4f32-89f2-074fba0becbc,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:48.875617 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:48.992764 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-3f527d37-8a45-4909-9774-48eabe6f9c1d None None] Set router 1eb7a247-2042-41e7-b3b1-d7975f120426 gateway port host: None {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:45:49.020913 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Calling delete_port for 41dcd114-5772-4f32-89f2-074fba0becbc owned by network:router_gateway {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:49.106334 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-3f527d37-8a45-4909-9774-48eabe6f9c1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b934c70>, [{'id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'name': 'tempest-TestMinimumBasicScenario-1021459048-router', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:12Z', 'updated_at': '2021-05-25T16:45:48Z', 'revision_number': 6, 'project_id': '23d514b2a6d54d9780353478bc32379c', 'gw_port_host': None}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:49.111144 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f527d37-8a45-4909-9774-48eabe6f9c1d None None] The sync data for ids ['1eb7a247-2042-41e7-b3b1-d7975f120426'] in dv-cinder-786386-6-iscsi is: [{'id': '1eb7a247-2042-41e7-b3b1-d7975f120426', 'name': 'tempest-TestMinimumBasicScenario-1021459048-router', 'tenant_id': '23d514b2a6d54d9780353478bc32379c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:43:12Z', 'updated_at': '2021-05-25T16:45:48Z', 'revision_number': 6, 'project_id': '23d514b2a6d54d9780353478bc32379c', 'gw_port_host': None}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:45:49.170456 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:49.175460 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-12245070-5b3d-42e3-861d-d606f2fa63a0 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:49.219171 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Pushing event deleted for resources: {'Port': ['ID=41dcd114-5772-4f32-89f2-074fba0becbc,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:49.245330 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:49.310926 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-501045'] for router_gateway, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:49.588345 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-507064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2357'] for router, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:49.590531 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:49.626199 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:45:49.674917 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-507780'] for router, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:49.675704 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1eb7a247-2042-41e7-b3b1-d7975f120426 {{(pid=92013) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 16:45:49.688170 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] Notify callbacks [] for router, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:49.689269 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-9cf995ec-0d0e-4441-9bb6-2344d2a3faa4 admin admin] 10.222.0.73 "DELETE /v2.0/routers/1eb7a247-2042-41e7-b3b1-d7975f120426 HTTP/1.1" status: 204  len: 168 time: 1.4250791
May 25 16:45:49.691824 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33054) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:49.750114 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_v2 [None req-53e9a04b-0c55-4c9e-97ea-27890f4de892 admin admin] Deleting subnet a3775705-1932-40b1-8dfa-8ffbe812af2a {{(pid=92013) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:45:49.752823 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-53e9a04b-0c55-4c9e-97ea-27890f4de892 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:49.802782 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-53e9a04b-0c55-4c9e-97ea-27890f4de892 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6928876'] for subnet, precommit_delete_associations {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:49.853283 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:49.881652 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-53e9a04b-0c55-4c9e-97ea-27890f4de892 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:49.893678 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:49.894304 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 39dbdfc1-4a8f-4ab3-b86d-c5113b292e19 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:50.163526 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-53e9a04b-0c55-4c9e-97ea-27890f4de892 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6928756', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7156487'] for subnet, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.168553 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:50.203355 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53e9a04b-0c55-4c9e-97ea-27890f4de892 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a3775705-1932-40b1-8dfa-8ffbe812af2a,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:50.205898 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-53e9a04b-0c55-4c9e-97ea-27890f4de892 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:50.209147 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-53e9a04b-0c55-4c9e-97ea-27890f4de892 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.220595 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8b6324c-7e72-444a-8695-f66a05a6b17e None None] Network c87eb745-c898-4ca2-8460-5db9ce1a5e3c requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:45:50.222275 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-53e9a04b-0c55-4c9e-97ea-27890f4de892 admin admin] 10.222.0.73 "DELETE /v2.0/subnets/a3775705-1932-40b1-8dfa-8ffbe812af2a HTTP/1.1" status: 204  len: 168 time: 0.5290332
May 25 16:45:50.225728 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33066) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:50.257206 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33070) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:50.333118 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.381262 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5103c6cd-8b37-440c-91aa-17ff770ee2db admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.396612 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-5103c6cd-8b37-440c-91aa-17ff770ee2db admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:45:50.400450 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-5103c6cd-8b37-440c-91aa-17ff770ee2db admin admin] Usage tracker for resource:security_group_rule and tenant:9f288aedd3b64ed78ebe1ad9a1b0a082 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:45:50.403524 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-5103c6cd-8b37-440c-91aa-17ff770ee2db admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:45:50.406772 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Deleting port 0e33baae-1478-499c-8497-699ef6dec17f {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:50.407215 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.409270 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-5103c6cd-8b37-440c-91aa-17ff770ee2db admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:45:50.485557 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b8148c1-04d2-406d-92fe-afe58f31445e None None] DHCP port deletion for c87eb745-c898-4ca2-8460-5db9ce1a5e3c request from dv-cinder-786386-6-iscsi {{(pid=92014) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 16:45:50.501656 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5103c6cd-8b37-440c-91aa-17ff770ee2db admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.506853 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-5103c6cd-8b37-440c-91aa-17ff770ee2db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.513223 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] For port 0e33baae-1478-499c-8497-699ef6dec17f, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=0e33baae-1478-499c-8497-699ef6dec17f,segment=NetworkSegment(6f2fbde7-1734-4509-9381-f214bf3ae61a),segment_id=6f2fbde7-1734-4509-9381-f214bf3ae61a)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:50.513620 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.519458 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-e3a0f621-ef94-4460-b1f7-44d9bcd7f560 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:50.556845 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-5103c6cd-8b37-440c-91aa-17ff770ee2db admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=9f288aedd3b64ed78ebe1ad9a1b0a082&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2985218
May 25 16:45:50.560471 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33076) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:50.569005 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-3b8148c1-04d2-406d-92fe-afe58f31445e None None] Deleting port 0e33baae-1478-499c-8497-699ef6dec17f {{(pid=92014) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:45:50.569473 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-3b8148c1-04d2-406d-92fe-afe58f31445e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.577360 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5103c6cd-8b37-440c-91aa-17ff770ee2db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=67d7987a-c969-49f2-becd-c1035cff5349,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:50.586010 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-5103c6cd-8b37-440c-91aa-17ff770ee2db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:50.629795 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d721b70c-ef0d-40d7-8cea-deed9e07de4a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.646248 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Calling delete_port for 0e33baae-1478-499c-8497-699ef6dec17f owned by network:dhcp {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:50.657835 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d721b70c-ef0d-40d7-8cea-deed9e07de4a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.680098 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-3b8148c1-04d2-406d-92fe-afe58f31445e None None] For port 0e33baae-1478-499c-8497-699ef6dec17f, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=0e33baae-1478-499c-8497-699ef6dec17f,segment=NetworkSegment(6f2fbde7-1734-4509-9381-f214bf3ae61a),segment_id=6f2fbde7-1734-4509-9381-f214bf3ae61a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:50.680482 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-3b8148c1-04d2-406d-92fe-afe58f31445e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.700743 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.705716 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:50.714466 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d721b70c-ef0d-40d7-8cea-deed9e07de4a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.718300 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-679cc475-ea03-48fb-af01-d42f1091bd97 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:50.729860 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d721b70c-ef0d-40d7-8cea-deed9e07de4a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=67d7987a-c969-49f2-becd-c1035cff5349,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:50.740502 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-d721b70c-ef0d-40d7-8cea-deed9e07de4a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:50.748112 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Pushing event deleted for resources: {'Port': ['ID=0e33baae-1478-499c-8497-699ef6dec17f,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:50.748830 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d721b70c-ef0d-40d7-8cea-deed9e07de4a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.751794 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-d721b70c-ef0d-40d7-8cea-deed9e07de4a admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/67d7987a-c969-49f2-becd-c1035cff5349 HTTP/1.1" status: 204  len: 168 time: 0.1898351
May 25 16:45:50.751931 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:50.752590 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] No DVR routers for this DVR port 0e33baae-1478-499c-8497-699ef6dec17f on host dv-cinder-786386-6-iscsi {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:50.817854 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-3b8148c1-04d2-406d-92fe-afe58f31445e None None] Calling delete_port for 0e33baae-1478-499c-8497-699ef6dec17f owned by network:dhcp {{(pid=92014) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:45:50.866302 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-3b8148c1-04d2-406d-92fe-afe58f31445e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244'] for port, after_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.872989 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:50.875148 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.888542 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346a3c86a0>,) {'filters': {'network_id': ['c87eb745-c898-4ca2-8460-5db9ce1a5e3c']}} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:50.901291 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346a3c86a0>, '6f2fbde7-1734-4509-9381-f214bf3ae61a') {'for_net_delete': True} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:50.901677 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346a3c86a0>, '6f2fbde7-1734-4509-9381-f214bf3ae61a') {} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:45:50.913585 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6928871'] for segment, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.916191 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b8148c1-04d2-406d-92fe-afe58f31445e None None] Pushing event deleted for resources: {'Port': ['ID=0e33baae-1478-499c-8497-699ef6dec17f,revision_number=None']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:50.918769 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-3b8148c1-04d2-406d-92fe-afe58f31445e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:50.921298 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b8148c1-04d2-406d-92fe-afe58f31445e None None] No DVR routers for this DVR port 0e33baae-1478-499c-8497-699ef6dec17f on host dv-cinder-786386-6-iscsi {{(pid=92014) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:45:50.938105 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.944534 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Releasing vlan 404 on physical network physnet1 to pool {{(pid=92013) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:45:50.944914 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7025874'] for segment, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]: Traceback (most recent call last):
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     timer()
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     cb(*args, **kw)
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     return func(*args, **kwargs)
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     self._notify()
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     self.callback(batched_events)
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     event.method(event)
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     return f(self, *a, **k)
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self._get(url).json()
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self.request(url, 'GET', **kwargs)
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:45:50.958542 dv-cinder-786386-6-iscsi neutron-server[92013]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:45:51.082549 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33086) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:51.105746 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c8f3c1ef-4dcd-4c66-86cd-550867e419e9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:51.120866 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c8f3c1ef-4dcd-4c66-86cd-550867e419e9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:45:51.124630 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c8f3c1ef-4dcd-4c66-86cd-550867e419e9 admin admin] Usage tracker for resource:security_group_rule and tenant:779579b4d68c41a79f11fa3797335713 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:45:51.129130 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-c8f3c1ef-4dcd-4c66-86cd-550867e419e9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:45:51.133226 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:51.135324 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-c8f3c1ef-4dcd-4c66-86cd-550867e419e9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:45:51.137270 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c0ccb108-0fa8-427c-9750-e0e3a60c635c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:51.151390 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:51.162843 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Pushing event deleted for resources: {'Network': ['ID=c87eb745-c898-4ca2-8460-5db9ce1a5e3c,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:51.168184 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] 10.222.0.73 "DELETE /v2.0/networks/c87eb745-c898-4ca2-8460-5db9ce1a5e3c HTTP/1.1" status: 204  len: 168 time: 0.9386086
May 25 16:45:51.168184 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:51.219681 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c8f3c1ef-4dcd-4c66-86cd-550867e419e9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:51.224547 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c8f3c1ef-4dcd-4c66-86cd-550867e419e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:51.233376 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-17bdad9c-fc6e-48e0-a903-dcda207af5ea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:51.277257 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c8f3c1ef-4dcd-4c66-86cd-550867e419e9 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=779579b4d68c41a79f11fa3797335713&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1935062
May 25 16:45:51.279137 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33092) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:51.279640 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8f3c1ef-4dcd-4c66-86cd-550867e419e9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b29ff84d-36b4-4142-a83a-af14a1501ec8,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:51.287006 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c8f3c1ef-4dcd-4c66-86cd-550867e419e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:51.344781 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 41dcd114-5772-4f32-89f2-074fba0becbc no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:51.349480 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-165cbf1e-3f8b-4252-961d-f8ffb0b7b513 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:51.370905 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33096) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:51.377662 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-165cbf1e-3f8b-4252-961d-f8ffb0b7b513 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:51.392415 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 41dcd114-5772-4f32-89f2-074fba0becbc {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:51.392899 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 41dcd114-5772-4f32-89f2-074fba0becbc not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:51.394222 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 0e33baae-1478-499c-8497-699ef6dec17f no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:45:51.428243 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-06562de9-f7d5-483e-8deb-1f1247af551d admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=99ba5095326e4a449eb209304e90545f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0561147
May 25 16:45:51.429102 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 0e33baae-1478-499c-8497-699ef6dec17f {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:45:51.429638 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 0e33baae-1478-499c-8497-699ef6dec17f not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:45:51.430033 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33100) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:51.451601 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-165cbf1e-3f8b-4252-961d-f8ffb0b7b513 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:51.456509 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-87d6e840-1f1d-4ac1-9afa-9df19dbd0c79 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:51.467940 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-165cbf1e-3f8b-4252-961d-f8ffb0b7b513 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b29ff84d-36b4-4142-a83a-af14a1501ec8,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:51.470838 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-165cbf1e-3f8b-4252-961d-f8ffb0b7b513 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:51.473886 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-165cbf1e-3f8b-4252-961d-f8ffb0b7b513 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:51.477929 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-165cbf1e-3f8b-4252-961d-f8ffb0b7b513 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/b29ff84d-36b4-4142-a83a-af14a1501ec8 HTTP/1.1" status: 204  len: 168 time: 0.1948898
May 25 16:45:51.499572 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-afff89e7-41d6-42a2-b23e-1bbaece4219e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:51.525826 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-afff89e7-41d6-42a2-b23e-1bbaece4219e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:51.585059 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-afff89e7-41d6-42a2-b23e-1bbaece4219e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:51.590061 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-ae1f37dd-dc2f-40bd-9f65-cf57703679fa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:51.604969 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afff89e7-41d6-42a2-b23e-1bbaece4219e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87adbc8b-3d4f-4d64-a49b-750ed4406f55,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:51.613140 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-afff89e7-41d6-42a2-b23e-1bbaece4219e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:51.617292 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-afff89e7-41d6-42a2-b23e-1bbaece4219e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:51.620759 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-afff89e7-41d6-42a2-b23e-1bbaece4219e admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/87adbc8b-3d4f-4d64-a49b-750ed4406f55 HTTP/1.1" status: 204  len: 168 time: 0.1874998
May 25 16:45:51.974181 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33120) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:52.021973 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-321e1563-e92e-44a4-acbe-6d0a8c62bdde admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=23d514b2a6d54d9780353478bc32379c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0464921
May 25 16:45:52.024419 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33124) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:52.083468 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b7b1c18d-2504-482a-aa38-a7ca78bbed0b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:52.110329 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b7b1c18d-2504-482a-aa38-a7ca78bbed0b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:52.172861 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b7b1c18d-2504-482a-aa38-a7ca78bbed0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:52.176731 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f5237ae6-1bca-443c-8b29-dfc8866622a5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:52.188250 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7b1c18d-2504-482a-aa38-a7ca78bbed0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=edb6a6fb-0714-42bc-8b9c-50083ef4be6d,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:52.190569 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-b7b1c18d-2504-482a-aa38-a7ca78bbed0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:52.196118 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-b7b1c18d-2504-482a-aa38-a7ca78bbed0b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:52.197218 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-b7b1c18d-2504-482a-aa38-a7ca78bbed0b admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/edb6a6fb-0714-42bc-8b9c-50083ef4be6d HTTP/1.1" status: 204  len: 168 time: 0.1719389
May 25 16:45:52.794930 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33148) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:52.909033 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6ff21c8c-56b0-4189-95fb-8a2a4eaa604b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:52.924435 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-6ff21c8c-56b0-4189-95fb-8a2a4eaa604b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:45:52.928135 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-6ff21c8c-56b0-4189-95fb-8a2a4eaa604b admin admin] Usage tracker for resource:security_group_rule and tenant:e5e43069d7ca4603af506dfa8b236c3f is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:45:52.930892 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-6ff21c8c-56b0-4189-95fb-8a2a4eaa604b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:45:52.936734 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-6ff21c8c-56b0-4189-95fb-8a2a4eaa604b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:45:53.018949 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6ff21c8c-56b0-4189-95fb-8a2a4eaa604b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:53.022669 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-6ff21c8c-56b0-4189-95fb-8a2a4eaa604b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:53.031035 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-06ab1c0c-b41c-40bd-b1bf-e3be99d64c7d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:53.070500 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-6ff21c8c-56b0-4189-95fb-8a2a4eaa604b admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=e5e43069d7ca4603af506dfa8b236c3f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2745175
May 25 16:45:53.072103 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ff21c8c-56b0-4189-95fb-8a2a4eaa604b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37c6f814-680e-475c-ad69-7181ec01b296,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:53.073147 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33154) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:45:53.075194 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-6ff21c8c-56b0-4189-95fb-8a2a4eaa604b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:53.130926 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5d1ceef5-aa1f-4a27-9706-7fca52cf0cca admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:53.155517 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5d1ceef5-aa1f-4a27-9706-7fca52cf0cca admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:53.207598 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5d1ceef5-aa1f-4a27-9706-7fca52cf0cca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:53.211505 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-90961428-5ddc-48bc-9272-bf706d390936 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:53.224744 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d1ceef5-aa1f-4a27-9706-7fca52cf0cca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37c6f814-680e-475c-ad69-7181ec01b296,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:53.227636 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-5d1ceef5-aa1f-4a27-9706-7fca52cf0cca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:53.229619 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-5d1ceef5-aa1f-4a27-9706-7fca52cf0cca admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:53.234633 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-5d1ceef5-aa1f-4a27-9706-7fca52cf0cca admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/37c6f814-680e-475c-ad69-7181ec01b296 HTTP/1.1" status: 204  len: 168 time: 0.1564775
May 25 16:45:53.518451 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-105d321f-7c7e-4abd-912e-ac5823e275ba tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:53.519888 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-105d321f-7c7e-4abd-912e-ac5823e275ba tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/networks?id=b737aee3-c586-4315-91bd-90bf18067410 HTTP/1.1" status: 200  len: 814 time: 0.1458151
May 25 16:45:53.535281 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-94e01de2-4162-4e44-87a5-43358b1865fd tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/quotas/a08b794404294bb48dc9c4982f9bfecb HTTP/1.1" status: 200  len: 375 time: 0.0098350
May 25 16:45:53.589069 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-a20dceda-34c0-4302-8d1d-ee2b38a21453 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=a08b794404294bb48dc9c4982f9bfecb&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0483625
May 25 16:45:53.731362 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-fd79496b-74d0-4db0-9ed2-5393b1ab37f4 service neutron] 10.222.0.73 "GET /v2.0/networks/b737aee3-c586-4315-91bd-90bf18067410?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1313734
May 25 16:45:53.871302 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-5a2d8f70-4f9e-4786-af84-4188c94e869d service neutron] 10.222.0.73 "GET /v2.0/networks/b737aee3-c586-4315-91bd-90bf18067410?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1353962
May 25 16:45:54.046245 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ba16af93-34e5-4a69-a8b9-dccb9d9f577f req-6227b7b1-79b4-4c62-a737-95887a703d3c tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 210 time: 0.0429478
May 25 16:45:55.251137 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0e78fe49-5ee2-404c-b113-70831860b327 req-20093d60-521f-4eb6-95b5-b0e32de4a9e2 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 210 time: 0.0611231
May 25 16:45:55.316018 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-24c50e31-48d6-44ad-af6b-f862b2fc373a tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:55.317579 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-24c50e31-48d6-44ad-af6b-f862b2fc373a tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.76 "GET /v2.0/networks?id=b737aee3-c586-4315-91bd-90bf18067410 HTTP/1.1" status: 200  len: 814 time: 0.2146590
May 25 16:45:55.331781 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Request body: {'port': {'device_id': '4fbb7f2a-5caf-4ade-99c8-840e787e5073', 'network_id': 'b737aee3-c586-4315-91bd-90bf18067410', 'admin_state_up': True, 'tenant_id': 'a08b794404294bb48dc9c4982f9bfecb'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:45:55.466069 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:45:55.475562 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:45:55.488177 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Made reservation on behalf of a08b794404294bb48dc9c4982f9bfecb for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:45:55.492528 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:55.658230 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Allocated IP 172.20.0.14 (b737aee3-c586-4315-91bd-90bf18067410/01b9c44a-4fab-499e-be63-34da3c8d98f4/18152244-25a7-4274-9b4a-c1e5d42e6913) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:45:55.872133 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:55.903102 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:55.916361 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-47f3d9f7-a5a3-4cb9-890d-4d7e4ebbcc09 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:55.983678 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Network b737aee3-c586-4315-91bd-90bf18067410 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:45:55.987345 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:45:55.989709 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:45:56.037083 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Pushing event updated for resources: {'Port': ['ID=18152244-25a7-4274-9b4a-c1e5d42e6913,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:56.039898 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:56.067391 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:56.067993 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:56.091642 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-90d64d6c-5ca8-45fb-94dc-d43c62991f54 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.7642810
May 25 16:45:56.104179 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Request body: {'port': {'device_id': '4fbb7f2a-5caf-4ade-99c8-840e787e5073', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:45:56.317383 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:56.596531 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d12b5ee-e0e5-4a38-8a7d-520258c7ffb8 req-4acaa5a7-1201-4832-95d6-025bf909c7a8 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:56.597669 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-5d12b5ee-e0e5-4a38-8a7d-520258c7ffb8 req-4acaa5a7-1201-4832-95d6-025bf909c7a8 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Synchronizing usage tracker for tenant:a08b794404294bb48dc9c4982f9bfecb on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:45:56.637131 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-5d12b5ee-e0e5-4a38-8a7d-520258c7ffb8 req-4acaa5a7-1201-4832-95d6-025bf909c7a8 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Unset dirty status for tenant:a08b794404294bb48dc9c4982f9bfecb on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:45:56.638320 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5d12b5ee-e0e5-4a38-8a7d-520258c7ffb8 req-4acaa5a7-1201-4832-95d6-025bf909c7a8 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 932 time: 0.2710605
May 25 16:45:56.703170 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5d12b5ee-e0e5-4a38-8a7d-520258c7ffb8 req-16b98589-07df-487e-965f-73726621ac3e tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0576096
May 25 16:45:56.775959 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 18152244-25a7-4274-9b4a-c1e5d42e6913 {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:45:56.783033 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:56.798996 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Transition to ACTIVE for port object 18152244-25a7-4274-9b4a-c1e5d42e6913 will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:45:56.803043 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:56.806825 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-0b9270a1-59a5-47ca-9aa6-000d934942c0 tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:56.957789 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Pushing event updated for resources: {'Port': ['ID=18152244-25a7-4274-9b4a-c1e5d42e6913,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:56.965018 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:57.038724 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Attempting to bind port 18152244-25a7-4274-9b4a-c1e5d42e6913 on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:45:57.039058 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Attempting to bind port 18152244-25a7-4274-9b4a-c1e5d42e6913 by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '24e045d0-637a-4a9d-af18-175fe9d4147a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'b737aee3-c586-4315-91bd-90bf18067410'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:45:57.039384 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Attempting to bind port 18152244-25a7-4274-9b4a-c1e5d42e6913 on network b737aee3-c586-4315-91bd-90bf18067410 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:45:57.044123 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Port 18152244-25a7-4274-9b4a-c1e5d42e6913 on network b737aee3-c586-4315-91bd-90bf18067410 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:45:57.044465 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Attempting to bind port 18152244-25a7-4274-9b4a-c1e5d42e6913 on network b737aee3-c586-4315-91bd-90bf18067410 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:45:57.050141 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 45, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:45:57.050462 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Checking segment: {'id': '24e045d0-637a-4a9d-af18-175fe9d4147a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'b737aee3-c586-4315-91bd-90bf18067410'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:45:57.050841 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Bound using segment: {'id': '24e045d0-637a-4a9d-af18-175fe9d4147a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'b737aee3-c586-4315-91bd-90bf18067410'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:45:57.051254 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Bound port: 18152244-25a7-4274-9b4a-c1e5d42e6913, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '24e045d0-637a-4a9d-af18-175fe9d4147a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'b737aee3-c586-4315-91bd-90bf18067410'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:45:57.051599 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:57.139013 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] For port 18152244-25a7-4274-9b4a-c1e5d42e6913, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:45:57.142102 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] For port 18152244-25a7-4274-9b4a-c1e5d42e6913, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=18152244-25a7-4274-9b4a-c1e5d42e6913,segment=NetworkSegment(24e045d0-637a-4a9d-af18-175fe9d4147a),segment_id=24e045d0-637a-4a9d-af18-175fe9d4147a)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:45:57.146519 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:57.150031 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-4e6663c1-89fc-41af-813b-ca56ea67491c tempest-AttachVolumeTestJSON-491589216 tempest-AttachVolumeTestJSON-491589216-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:57.209753 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:57.210426 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:57.211759 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] 10.222.0.76 "PUT /v2.0/ports/18152244-25a7-4274-9b4a-c1e5d42e6913 HTTP/1.1" status: 200  len: 1094 time: 1.1115258
May 25 16:45:57.212247 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4fbb7f2a-5caf-4ade-99c8-840e787e5073', 'tag': '18152244-25a7-4274-9b4a-c1e5d42e6913'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:45:57.231679 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Pushing event updated for resources: {'Port': ['ID=18152244-25a7-4274-9b4a-c1e5d42e6913,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:57.234651 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:57.284693 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4fbb7f2a-5caf-4ade-99c8-840e787e5073', 'tag': '18152244-25a7-4274-9b4a-c1e5d42e6913', 'status': 'completed', 'code': 200}
May 25 16:45:57.324738 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-8663d147-b9e9-4947-ad77-0f3dc31d9c06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:57.326231 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-8663d147-b9e9-4947-ad77-0f3dc31d9c06 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a08b794404294bb48dc9c4982f9bfecb&device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 1097 time: 0.0734160
May 25 16:45:57.396151 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-837baa66-4586-4608-8f4b-873274899318 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=18152244-25a7-4274-9b4a-c1e5d42e6913 HTTP/1.1" status: 200  len: 217 time: 0.0625496
May 25 16:45:57.460145 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-00b4e22c-a5fc-481a-bd9a-d81584f26b39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:57.461558 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-00b4e22c-a5fc-481a-bd9a-d81584f26b39 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=01b9c44a-4fab-499e-be63-34da3c8d98f4 HTTP/1.1" status: 200  len: 854 time: 0.0579464
May 25 16:45:57.511398 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-a7e630f7-c623-4113-bf6d-b4699aa59c52 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b737aee3-c586-4315-91bd-90bf18067410&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0396516
May 25 16:45:57.644364 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-26674363-9910-4086-bbcc-36dc8fb66b87 service neutron] 10.222.0.76 "GET /v2.0/networks/b737aee3-c586-4315-91bd-90bf18067410?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1255610
May 25 16:45:57.782339 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-001cebb7-985b-4177-b79a-a03ae593ed4f req-5136052e-9f9f-4fc1-b9f7-43cd64b35e80 service neutron] 10.222.0.76 "GET /v2.0/networks/b737aee3-c586-4315-91bd-90bf18067410?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1279962
May 25 16:45:58.050379 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d0d2a18-da0b-4092-9544-6f9555245017 req-4b68d3e5-7abb-4d86-9201-9f15f5aa4b61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:58.051731 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9d0d2a18-da0b-4092-9544-6f9555245017 req-4b68d3e5-7abb-4d86-9201-9f15f5aa4b61 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=a08b794404294bb48dc9c4982f9bfecb&device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 1097 time: 0.1017916
May 25 16:45:58.059302 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15031f87-2413-4825-935d-15cdb598e1e5 req-3ad72866-ea95-490c-b00e-0f54ae131203 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:58.060608 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-15031f87-2413-4825-935d-15cdb598e1e5 req-3ad72866-ea95-490c-b00e-0f54ae131203 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 944 time: 0.2412500
May 25 16:45:58.186722 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-15031f87-2413-4825-935d-15cdb598e1e5 req-65f6a13e-1278-4ed3-b8b2-b7780bdcfdfa tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1077561
May 25 16:45:58.220725 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d0d2a18-da0b-4092-9544-6f9555245017 req-54e871cb-8965-4b34-8128-b41ca37a9279 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:58.222192 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9d0d2a18-da0b-4092-9544-6f9555245017 req-54e871cb-8965-4b34-8128-b41ca37a9279 service neutron] 10.222.0.76 "GET /v2.0/networks?id=b737aee3-c586-4315-91bd-90bf18067410 HTTP/1.1" status: 200  len: 915 time: 0.1607723
May 25 16:45:58.303855 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9d0d2a18-da0b-4092-9544-6f9555245017 req-46bd963b-4794-4409-9a17-5f8bffc98a0f service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=18152244-25a7-4274-9b4a-c1e5d42e6913 HTTP/1.1" status: 200  len: 217 time: 0.0724001
May 25 16:45:58.374141 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d0d2a18-da0b-4092-9544-6f9555245017 req-31b8aa3d-a731-4914-aa5e-b0f785e41398 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:58.375599 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9d0d2a18-da0b-4092-9544-6f9555245017 req-31b8aa3d-a731-4914-aa5e-b0f785e41398 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=01b9c44a-4fab-499e-be63-34da3c8d98f4 HTTP/1.1" status: 200  len: 854 time: 0.0635374
May 25 16:45:58.425212 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9d0d2a18-da0b-4092-9544-6f9555245017 req-d6c87ee7-08d5-40cc-b9c3-e4ca3d27e905 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=b737aee3-c586-4315-91bd-90bf18067410&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0402853
May 25 16:45:58.559940 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9d0d2a18-da0b-4092-9544-6f9555245017 req-f5f7272b-17db-4a91-b985-4cabe0367734 service neutron] 10.222.0.76 "GET /v2.0/networks/b737aee3-c586-4315-91bd-90bf18067410?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1245921
May 25 16:45:58.729196 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-9d0d2a18-da0b-4092-9544-6f9555245017 req-5f397c5f-e341-466c-ad64-950505541ca5 service neutron] 10.222.0.76 "GET /v2.0/networks/b737aee3-c586-4315-91bd-90bf18067410?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1576853
May 25 16:45:59.123220 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 18152244-25a7-4274-9b4a-c1e5d42e6913 details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:45:59.261811 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 18152244-25a7-4274-9b4a-c1e5d42e6913, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=18152244-25a7-4274-9b4a-c1e5d42e6913,segment=NetworkSegment(24e045d0-637a-4a9d-af18-175fe9d4147a),segment_id=24e045d0-637a-4a9d-af18-175fe9d4147a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:59.275883 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '18152244-25a7-4274-9b4a-c1e5d42e6913', 'network_id': 'b737aee3-c586-4315-91bd-90bf18067410', 'port_id': '18152244-25a7-4274-9b4a-c1e5d42e6913', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 419, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '01b9c44a-4fab-499e-be63-34da3c8d98f4', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:45:59.370934 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:59.387315 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bac2958b-d56c-4d36-99e6-afc29497e6ad req-ab9dceb7-5dba-4e1d-9717-be81b2bc2a56 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:45:59.388862 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bac2958b-d56c-4d36-99e6-afc29497e6ad req-ab9dceb7-5dba-4e1d-9717-be81b2bc2a56 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 944 time: 0.0918841
May 25 16:45:59.388989 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 18152244-25a7-4274-9b4a-c1e5d42e6913 {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:45:59.407661 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 18152244-25a7-4274-9b4a-c1e5d42e6913, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=18152244-25a7-4274-9b4a-c1e5d42e6913,segment=NetworkSegment(24e045d0-637a-4a9d-af18-175fe9d4147a),segment_id=24e045d0-637a-4a9d-af18-175fe9d4147a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:45:59.411622 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:45:59.413639 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:45:59.435870 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bac2958b-d56c-4d36-99e6-afc29497e6ad req-0fcc4f29-d504-44c5-bf35-cf1f7b8e1618 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390801
May 25 16:45:59.479644 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=18152244-25a7-4274-9b4a-c1e5d42e6913,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:45:59.487361 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:59.487706 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:59.488043 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:59.488390 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:59.488703 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:59.489034 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:59.489355 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:59.489706 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:59.490027 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:59.490345 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:59.490659 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:59.490981 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:45:59.494759 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:45:59.683363 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['18152244-25a7-4274-9b4a-c1e5d42e6913'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:46:00.619471 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56bcd4a8-772b-4ce8-aa57-235f7b758176 req-8618f814-5a04-479d-8dca-f67665bacc49 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:46:00.620903 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-56bcd4a8-772b-4ce8-aa57-235f7b758176 req-8618f814-5a04-479d-8dca-f67665bacc49 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 945 time: 0.0816245
May 25 16:46:00.666302 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-56bcd4a8-772b-4ce8-aa57-235f7b758176 req-7006786e-88b1-40fc-a5d3-6367f84c7ae8 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392101
May 25 16:46:01.135288 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 18152244-25a7-4274-9b4a-c1e5d42e6913 up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:46:01.211338 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 18152244-25a7-4274-9b4a-c1e5d42e6913 completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:46:01.215986 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 18152244-25a7-4274-9b4a-c1e5d42e6913 triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:46:01.216364 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:01.365172 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:01.392187 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4fbb7f2a-5caf-4ade-99c8-840e787e5073', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18152244-25a7-4274-9b4a-c1e5d42e6913'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:46:01.403535 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 18152244-25a7-4274-9b4a-c1e5d42e6913, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=18152244-25a7-4274-9b4a-c1e5d42e6913,segment=NetworkSegment(24e045d0-637a-4a9d-af18-175fe9d4147a),segment_id=24e045d0-637a-4a9d-af18-175fe9d4147a)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:46:01.408171 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:01.412148 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:46:01.452088 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4fbb7f2a-5caf-4ade-99c8-840e787e5073', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18152244-25a7-4274-9b4a-c1e5d42e6913', 'code': 200}
May 25 16:46:01.480259 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4dd75c55-4cfd-4189-86fd-0be692636fde None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:01.493047 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=18152244-25a7-4274-9b4a-c1e5d42e6913,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:46:01.495858 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:46:01.679704 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-159b58ec-f4d2-4c42-af40-3953ab13e424 req-047a3961-a715-4a8f-a18b-ef71dccc2484 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:46:01.681086 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-159b58ec-f4d2-4c42-af40-3953ab13e424 req-047a3961-a715-4a8f-a18b-ef71dccc2484 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 1099 time: 0.0778787
May 25 16:46:01.725896 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-159b58ec-f4d2-4c42-af40-3953ab13e424 req-5cc8000f-a041-4b99-829b-5f13726a4ca9 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0363350
May 25 16:46:01.858666 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c1b397c-9d90-4e02-be1c-d7f587371504 req-fb94d26d-88f3-4fbe-90a6-34467456546f tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:46:01.860296 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4c1b397c-9d90-4e02-be1c-d7f587371504 req-fb94d26d-88f3-4fbe-90a6-34467456546f tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 946 time: 0.0794313
May 25 16:46:01.908237 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4c1b397c-9d90-4e02-be1c-d7f587371504 req-02949acf-bbe2-42d0-b8c8-880a6c99cd42 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417206
May 25 16:46:03.092963 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b04d8e7-da8d-45b7-a158-3d7db12ff550 req-b0f08017-ccad-4232-ab0d-7f7f3dde1af1 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:46:03.094437 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3b04d8e7-da8d-45b7-a158-3d7db12ff550 req-b0f08017-ccad-4232-ab0d-7f7f3dde1af1 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 946 time: 0.0792291
May 25 16:46:03.139797 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3b04d8e7-da8d-45b7-a158-3d7db12ff550 req-82c32fbd-4231-4ddf-9b58-d58c2c7a7e99 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396624
May 25 16:46:03.846846 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:04.108177 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-927b66bb-65de-4113-be17-d5d68410f58c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:05.072739 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:06.591348 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:14.227242 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:16.289310 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33394) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:46:16.405246 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:16.419018 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:46:16.422974 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Usage tracker for resource:security_group_rule and tenant:5759548722434ce281b6051d60580001 is out of sync, need to count used quota {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:46:16.426455 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.quota.resource [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92012) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:46:16.432099 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.quota.driver [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92012) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:46:16.526740 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:16.530528 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_create {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:16.538691 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-59e8ec59-f200-4434-8af3-a0ac8cd82d2e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:46:16.582239 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=5759548722434ce281b6051d60580001&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2918620
May 25 16:46:16.583025 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bdbc4fe5-c729-4f38-a156-03715218fa63,revision_number=1']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:46:16.584942 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33400) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:46:16.590374 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.590770 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.591128 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.591490 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.591850 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.592216 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.592571 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.592927 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.593284 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.593661 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.594014 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.594363 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.598849 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-12bc14c3-2be6-4ea6-8a11-0b49ec6d0146 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:46:16.644446 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:16.669762 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:16.724930 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:16.728948 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-d264834c-304b-45bd-b958-6462e395b7ff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:46:16.742356 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bdbc4fe5-c729-4f38-a156-03715218fa63,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:46:16.751315 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.751688 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.752143 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.752505 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.752861 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.753233 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.753607 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.753959 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.754314 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.754660 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.755007 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.755350 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:46:16.757936 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:16.759049 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/bdbc4fe5-c729-4f38-a156-03715218fa63 HTTP/1.1" status: 204  len: 168 time: 0.1729641
May 25 16:46:16.759931 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-1e31f2ae-2c60-4f39-a9c6-2b33c7064f91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:46:26.625505 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:46:26.669788 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14156e01-5791-42e1-a018-5d129ac614b4 req-72e250a5-ca29-4a61-bd81-bbfafa52c8bf tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:46:26.671239 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-14156e01-5791-42e1-a018-5d129ac614b4 req-72e250a5-ca29-4a61-bd81-bbfafa52c8bf tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 946 time: 0.0810142
May 25 16:46:26.715696 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-14156e01-5791-42e1-a018-5d129ac614b4 req-20f83967-cadf-4384-8fdd-c3f03af35812 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387149
May 25 16:46:27.903926 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cacbd7be-c1af-4515-9861-6d0a2e7ad77f req-1e3699bf-0918-448b-b2c1-93bab7226d43 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:46:27.905373 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cacbd7be-c1af-4515-9861-6d0a2e7ad77f req-1e3699bf-0918-448b-b2c1-93bab7226d43 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 946 time: 0.0824823
May 25 16:46:27.950669 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-cacbd7be-c1af-4515-9861-6d0a2e7ad77f req-6418f02f-6329-4415-9f7b-88690e379ae6 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396671
May 25 16:46:28.802268 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdbef6fb-2564-4412-8458-f81c5c44cde0 req-fde68cab-460c-4ccc-937c-a51dae8fb360 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:46:28.803742 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fdbef6fb-2564-4412-8458-f81c5c44cde0 req-fde68cab-460c-4ccc-937c-a51dae8fb360 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.76 "GET /v2.0/ports?device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 946 time: 0.0893469
May 25 16:46:29.024136 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-fdbef6fb-2564-4412-8458-f81c5c44cde0 req-7727eff1-5457-4a63-b900-4a016ab960fa tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Deleting port 18152244-25a7-4274-9b4a-c1e5d42e6913 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:46:29.024834 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-fdbef6fb-2564-4412-8458-f81c5c44cde0 req-7727eff1-5457-4a63-b900-4a016ab960fa tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:29.208449 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-fdbef6fb-2564-4412-8458-f81c5c44cde0 req-7727eff1-5457-4a63-b900-4a016ab960fa tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] For port 18152244-25a7-4274-9b4a-c1e5d42e6913, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=18152244-25a7-4274-9b4a-c1e5d42e6913,segment=NetworkSegment(24e045d0-637a-4a9d-af18-175fe9d4147a),segment_id=24e045d0-637a-4a9d-af18-175fe9d4147a)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:46:29.208804 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-fdbef6fb-2564-4412-8458-f81c5c44cde0 req-7727eff1-5457-4a63-b900-4a016ab960fa tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:29.342416 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-fdbef6fb-2564-4412-8458-f81c5c44cde0 req-7727eff1-5457-4a63-b900-4a016ab960fa tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Calling delete_port for 18152244-25a7-4274-9b4a-c1e5d42e6913 owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:46:29.354565 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ca80fa6-e704-42a6-80fd-4849aeefb3de req-e047b3f6-1354-4bd1-b816-b1ba3c51eb9b tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:46:29.356116 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1ca80fa6-e704-42a6-80fd-4849aeefb3de req-e047b3f6-1354-4bd1-b816-b1ba3c51eb9b tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/ports?device_id=4fbb7f2a-5caf-4ade-99c8-840e787e5073 HTTP/1.1" status: 200  len: 946 time: 0.2671399
May 25 16:46:29.413726 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1ca80fa6-e704-42a6-80fd-4849aeefb3de req-08468a14-4598-4d93-a43b-f46819f06ff4 tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.73 "GET /v2.0/security-groups?id=db9a1bae-fa34-4626-99d1-de81270c9f93&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0521169
May 25 16:46:29.497479 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-fdbef6fb-2564-4412-8458-f81c5c44cde0 req-7727eff1-5457-4a63-b900-4a016ab960fa tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:29.503662 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:46:29.547330 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7727eff1-5457-4a63-b900-4a016ab960fa tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Pushing event deleted for resources: {'Port': ['ID=18152244-25a7-4274-9b4a-c1e5d42e6913,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:46:29.550437 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-7727eff1-5457-4a63-b900-4a016ab960fa tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:46:29.624401 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-fdbef6fb-2564-4412-8458-f81c5c44cde0 req-7727eff1-5457-4a63-b900-4a016ab960fa tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] No DVR routers for this DVR port 18152244-25a7-4274-9b4a-c1e5d42e6913 on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:46:29.626976 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-fdbef6fb-2564-4412-8458-f81c5c44cde0 req-7727eff1-5457-4a63-b900-4a016ab960fa tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:29.631199 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4fbb7f2a-5caf-4ade-99c8-840e787e5073', 'name': 'network-vif-deleted', 'tag': '18152244-25a7-4274-9b4a-c1e5d42e6913'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:46:29.646885 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-fdbef6fb-2564-4412-8458-f81c5c44cde0 req-7727eff1-5457-4a63-b900-4a016ab960fa tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] 10.222.0.76 "DELETE /v2.0/ports/18152244-25a7-4274-9b4a-c1e5d42e6913 HTTP/1.1" status: 204  len: 173 time: 0.8357346
May 25 16:46:29.685489 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4fbb7f2a-5caf-4ade-99c8-840e787e5073', 'name': 'network-vif-deleted', 'tag': '18152244-25a7-4274-9b4a-c1e5d42e6913', 'status': 'completed', 'code': 200}
May 25 16:46:31.298379 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 18152244-25a7-4274-9b4a-c1e5d42e6913 no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:46:31.333285 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 18152244-25a7-4274-9b4a-c1e5d42e6913 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:46:31.333654 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 18152244-25a7-4274-9b4a-c1e5d42e6913 not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:46:31.421859 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2c13b097-8eeb-44dc-8016-302c9f447e71 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:33.852073 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:34.108711 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-08db32fb-0cab-4c34-9e9b-480bd1157cc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:35.075125 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:36.593810 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:44.228990 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:45.667093 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-96adf5be-b27b-4287-b97f-3ab853ec844d req-e4263f44-393c-463e-81d2-a591d7d666e5 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0761120
May 25 16:46:45.816605 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96adf5be-b27b-4287-b97f-3ab853ec844d req-2618701b-7e22-4afb-822e-cfe96ac36afb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:46:45.817988 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-96adf5be-b27b-4287-b97f-3ab853ec844d req-2618701b-7e22-4afb-822e-cfe96ac36afb service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 1099 time: 0.0759041
May 25 16:46:45.988514 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96adf5be-b27b-4287-b97f-3ab853ec844d req-57e66fae-69f7-403d-877b-43465448e8a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:46:45.990461 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-96adf5be-b27b-4287-b97f-3ab853ec844d req-57e66fae-69f7-403d-877b-43465448e8a0 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 913 time: 0.1514006
May 25 16:46:46.103274 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-96adf5be-b27b-4287-b97f-3ab853ec844d req-892edfbe-66b0-4291-9f07-39638e9b4083 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f HTTP/1.1" status: 200  len: 1002 time: 0.1036420
May 25 16:46:46.167576 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96adf5be-b27b-4287-b97f-3ab853ec844d req-f6df20c3-64ee-44bf-8d12-eaae28d8e74f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:46:46.168994 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-96adf5be-b27b-4287-b97f-3ab853ec844d req-f6df20c3-64ee-44bf-8d12-eaae28d8e74f service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.0558875
May 25 16:46:46.246955 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96adf5be-b27b-4287-b97f-3ab853ec844d req-ebad2d36-93a0-4bdd-af01-087a3285c245 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:46:46.248363 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-96adf5be-b27b-4287-b97f-3ab853ec844d req-ebad2d36-93a0-4bdd-af01-087a3285c245 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0684981
May 25 16:46:46.403389 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-96adf5be-b27b-4287-b97f-3ab853ec844d req-464e4cd7-d124-4c81-b47f-4d59a13517a2 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1425703
May 25 16:46:46.540603 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-96adf5be-b27b-4287-b97f-3ab853ec844d req-0093aaa7-5daf-4321-9342-8e38b809e379 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1260109
May 25 16:46:55.949074 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33594) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:46:56.102059 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_v2 [None req-ffc192cb-6dbf-427b-9181-2fce8b713364 admin admin] Deleting subnet 01b9c44a-4fab-499e-be63-34da3c8d98f4 {{(pid=92013) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:46:56.104878 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ffc192cb-6dbf-427b-9181-2fce8b713364 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:56.152851 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ffc192cb-6dbf-427b-9181-2fce8b713364 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6928876'] for subnet, precommit_delete_associations {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:56.209665 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ffc192cb-6dbf-427b-9181-2fce8b713364 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:56.447469 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ffc192cb-6dbf-427b-9181-2fce8b713364 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6928756', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7156487'] for subnet, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:56.451985 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-53e9a04b-0c55-4c9e-97ea-27890f4de892 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:46:56.490473 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-ffc192cb-6dbf-427b-9181-2fce8b713364 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:56.493132 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffc192cb-6dbf-427b-9181-2fce8b713364 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=01b9c44a-4fab-499e-be63-34da3c8d98f4,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:46:56.495306 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ffc192cb-6dbf-427b-9181-2fce8b713364 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:46:56.499607 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-ffc192cb-6dbf-427b-9181-2fce8b713364 admin admin] 10.222.0.73 "DELETE /v2.0/subnets/01b9c44a-4fab-499e-be63-34da3c8d98f4 HTTP/1.1" status: 204  len: 168 time: 0.5495138
May 25 16:46:56.502148 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33598) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:46:56.608088 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:56.731621 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:56.745154 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346afb5fd0>,) {'filters': {'network_id': ['b737aee3-c586-4315-91bd-90bf18067410']}} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:46:56.757119 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346afb5fd0>, '24e045d0-637a-4a9d-af18-175fe9d4147a') {'for_net_delete': True} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:46:56.757430 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346afb5fd0>, '24e045d0-637a-4a9d-af18-175fe9d4147a') {} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:46:56.768377 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6928871'] for segment, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:56.783712 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:56.790040 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] Releasing vlan 419 on physical network physnet1 to pool {{(pid=92013) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:46:56.790417 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7025874'] for segment, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]: Traceback (most recent call last):
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     timer()
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     cb(*args, **kw)
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     return func(*args, **kwargs)
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     self._notify()
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     self.callback(batched_events)
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     event.method(event)
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     return f(self, *a, **k)
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self._get(url).json()
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self.request(url, 'GET', **kwargs)
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:46:56.803660 dv-cinder-786386-6-iscsi neutron-server[92013]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:46:56.878765 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:56.883592 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:56.885975 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-5a7fe2d8-a330-4b06-86d9-5fe2a48b3b37 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:46:56.905926 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] Pushing event deleted for resources: {'Network': ['ID=b737aee3-c586-4315-91bd-90bf18067410,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:46:56.908309 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:46:56.915873 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-4d4bd2e4-0e01-4a0d-97e3-4aee7cc40336 admin admin] 10.222.0.73 "DELETE /v2.0/networks/b737aee3-c586-4315-91bd-90bf18067410 HTTP/1.1" status: 204  len: 168 time: 0.4127538
May 25 16:46:57.096585 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33604) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:46:57.144240 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-1e3ea015-9e12-43b1-9d78-21a99afe5f31 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=a08b794404294bb48dc9c4982f9bfecb&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0464852
May 25 16:46:57.146565 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33608) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:46:57.202666 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-133f197e-6b99-47c2-ab34-7213b940966a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:57.227362 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-133f197e-6b99-47c2-ab34-7213b940966a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:57.278340 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-133f197e-6b99-47c2-ab34-7213b940966a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:57.283048 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-b705ab17-ab9a-43d7-a241-49aa1d521d3b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:46:57.299320 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-133f197e-6b99-47c2-ab34-7213b940966a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=db9a1bae-fa34-4626-99d1-de81270c9f93,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:46:57.302286 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-133f197e-6b99-47c2-ab34-7213b940966a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:46:57.309696 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-133f197e-6b99-47c2-ab34-7213b940966a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:46:57.310791 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-133f197e-6b99-47c2-ab34-7213b940966a admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/db9a1bae-fa34-4626-99d1-de81270c9f93 HTTP/1.1" status: 204  len: 168 time: 0.1633739
May 25 16:47:01.423835 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-f364c977-630b-4e7f-bfe6-2666d9dd69e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:03.627304 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:47:03.854392 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:04.109098 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-1c656af9-df97-4796-a960-7f372566ce48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:05.078153 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:06.597771 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:14.243466 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:31.429896 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-34329270-4b87-49c2-8068-ce1712729a37 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:33.855808 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:34.112733 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-3c7cd96e-471e-4879-b604-22cc35ca3e19 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:35.081129 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:36.600289 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:38.349796 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-d3ef5ff8-5547-4071-bfc8-d6f35c83fc79 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1587326533&fields=id&tenant_id=577d706beb414387a68972cf7e8d0285 HTTP/1.1" status: 200  len: 267 time: 0.0396118
May 25 16:47:38.498089 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-d7fcfcff-c4f3-43f1-acba-3e6ae685c269 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:38.499410 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-d7fcfcff-c4f3-43f1-acba-3e6ae685c269 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 812 time: 0.1433601
May 25 16:47:38.513949 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-4b416b8d-196f-41a5-aad3-9e1267eb7eb4 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/quotas/577d706beb414387a68972cf7e8d0285 HTTP/1.1" status: 200  len: 375 time: 0.0092382
May 25 16:47:38.600979 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-65aff351-75f0-4f99-b409-bf1e366505d3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&fields=id HTTP/1.1" status: 200  len: 440 time: 0.0821595
May 25 16:47:38.616978 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-a20be613-5102-4ded-894e-e278cfcb8ef9 service neutron] http://10.222.0.73:9696/v2.0/extensions returned with HTTP 200 {{(pid=92013) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 16:47:38.617965 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-a20be613-5102-4ded-894e-e278cfcb8ef9 service neutron] 10.222.0.73 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0057194
May 25 16:47:38.751277 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-4c7b331b-d506-4f12-9766-053413f53e4a service neutron] 10.222.0.73 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1276248
May 25 16:47:38.878815 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-1285c49d-533d-4311-97db-efa59bb7ae89 service neutron] 10.222.0.73 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1223054
May 25 16:47:39.488673 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4d5c19b0-6a66-45c0-aad8-0f91071fc8b6 req-28f7794b-e90a-4079-8bb8-76c7984b03a1 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 210 time: 0.2618330
May 25 16:47:40.538943 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-84c2af50-4a48-4d07-92a4-df4238514db7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:40.540344 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-84c2af50-4a48-4d07-92a4-df4238514db7 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 812 time: 0.1550944
May 25 16:47:40.592050 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-c3df08e2-ccf8-492e-8480-fc66e1c47428 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=577d706beb414387a68972cf7e8d0285 HTTP/1.1" status: 200  len: 380 time: 0.0426345
May 25 16:47:40.626359 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:47:40.635498 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Request body: {'port': {'device_id': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'admin_state_up': True, 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'security_groups': ['63866e13-b231-485d-a031-21b53f908d39']}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:47:40.665151 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0d797c77-7926-4af6-a250-b50f17ed429b req-88200096-b757-41ef-a719-1d4b0215ce59 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 210 time: 0.0699022
May 25 16:47:40.785245 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:47:40.795220 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:47:40.805573 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Made reservation on behalf of 577d706beb414387a68972cf7e8d0285 for: {'port': 1} {{(pid=92013) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 16:47:40.809225 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:40.976060 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Allocated IP 172.20.0.8 (9c8cc949-bd51-40a0-bff3-5527e7341361/2f2f7850-0dc5-48dc-8602-816147b64784/32bc7380-a11f-44c9-83b2-c98c49f07e7b) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:47:41.168930 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:41.185334 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Transition to ACTIVE for port object 32bc7380-a11f-44c9-83b2-c98c49f07e7b will not be triggered until provisioned by entity DHCP. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:47:41.211729 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:41.217312 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-c123dcb6-4f7c-4ad2-895d-3fc41ac9a5d0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:47:41.288273 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Network 9c8cc949-bd51-40a0-bff3-5527e7341361 is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:47:41.291523 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:47:41.295565 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:47:41.332094 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'Port': ['ID=32bc7380-a11f-44c9-83b2-c98c49f07e7b,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:47:41.351525 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:41.351789 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:41.352091 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:41.352450 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:41.352806 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:41.353156 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:41.353534 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:41.353882 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:41.354228 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:41.354571 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:41.354913 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:41.355255 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:41.361551 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:47:41.376853 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:41.377495 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:41.409950 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-58fd3be8-d66a-4c93-a62d-a4f3d24eccc9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.7829390
May 25 16:47:41.420372 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-6f8cdaae-da5a-47b3-a246-bee92f021894 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] http://10.222.0.73:9696/v2.0/extensions returned with HTTP 200 {{(pid=92013) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 16:47:41.421498 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-6f8cdaae-da5a-47b3-a246-bee92f021894 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0052032
May 25 16:47:41.480839 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Request body: {'port': {'device_id': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78638'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:47:41.529133 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-b2085805-c748-4136-9ebf-972b82d0628c None None] Provisioning for port 32bc7380-a11f-44c9-83b2-c98c49f07e7b completed by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:47:41.533910 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-b2085805-c748-4136-9ebf-972b82d0628c None None] Provisioning complete for port 32bc7380-a11f-44c9-83b2-c98c49f07e7b triggered by entity DHCP. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:47:41.534355 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-b2085805-c748-4136-9ebf-972b82d0628c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:41.590788 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-b2085805-c748-4136-9ebf-972b82d0628c None None] Port 32bc7380-a11f-44c9-83b2-c98c49f07e7b cannot update to ACTIVE because it is not bound. {{(pid=92014) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 16:47:41.595033 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:41.934567 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71ead5c9-0670-4691-9cae-6ab534d8ee8d req-44b9ebd7-2256-47ec-a970-611aed9feb42 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:41.935249 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-71ead5c9-0670-4691-9cae-6ab534d8ee8d req-44b9ebd7-2256-47ec-a970-611aed9feb42 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Synchronizing usage tracker for tenant:577d706beb414387a68972cf7e8d0285 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:47:41.961158 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-71ead5c9-0670-4691-9cae-6ab534d8ee8d req-44b9ebd7-2256-47ec-a970-611aed9feb42 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Unset dirty status for tenant:577d706beb414387a68972cf7e8d0285 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:47:41.962226 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71ead5c9-0670-4691-9cae-6ab534d8ee8d req-44b9ebd7-2256-47ec-a970-611aed9feb42 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 931 time: 0.1559055
May 25 16:47:42.039736 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 32bc7380-a11f-44c9-83b2-c98c49f07e7b {{(pid=92013) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:47:42.050591 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:42.058784 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71ead5c9-0670-4691-9cae-6ab534d8ee8d req-4d45dc31-a606-4a0c-9888-0cac83622e44 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0662909
May 25 16:47:42.070192 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.provisioning_blocks [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Transition to ACTIVE for port object 32bc7380-a11f-44c9-83b2-c98c49f07e7b will not be triggered until provisioned by entity L2. {{(pid=92013) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 16:47:42.074419 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:42.078994 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-fa927d65-9db0-4a10-8a71-ce66171c2619 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:47:42.234813 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Pushing event updated for resources: {'Port': ['ID=32bc7380-a11f-44c9-83b2-c98c49f07e7b,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:47:42.335291 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.256s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:47:42.401384 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Attempting to bind port 32bc7380-a11f-44c9-83b2-c98c49f07e7b on host hv-cinder-78638 for vnic_type normal with profile  {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 16:47:42.401663 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Attempting to bind port 32bc7380-a11f-44c9-83b2-c98c49f07e7b by drivers openvswitch,hyperv on host hv-cinder-78638 at level 0 using segments [{'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 16:47:42.401993 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Attempting to bind port 32bc7380-a11f-44c9-83b2-c98c49f07e7b on network 9c8cc949-bd51-40a0-bff3-5527e7341361 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:47:42.406554 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Port 32bc7380-a11f-44c9-83b2-c98c49f07e7b on network 9c8cc949-bd51-40a0-bff3-5527e7341361 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78638 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 16:47:42.406874 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Attempting to bind port 32bc7380-a11f-44c9-83b2-c98c49f07e7b on network 9c8cc949-bd51-40a0-bff3-5527e7341361 {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 16:47:42.411850 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Checking agent: {'id': 'da536216-a9e1-4f04-93eb-f329fca4eb9a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78638', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'started_at': datetime.datetime(2021, 5, 25, 16, 35, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 47, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 16:47:42.412713 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Checking segment: {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92013) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 16:47:42.413092 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Bound using segment: {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'} {{(pid=92013) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 16:47:42.413560 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.managers [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Bound port: 32bc7380-a11f-44c9-83b2-c98c49f07e7b, host: hv-cinder-78638, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f90d03f-b69f-445e-ac5f-91537c20f661', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 435, 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361'}}] {{(pid=92013) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 16:47:42.413891 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:42.504147 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] For port 32bc7380-a11f-44c9-83b2-c98c49f07e7b, host hv-cinder-78638, cleared binding levels {{(pid=92013) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 16:47:42.507504 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] For port 32bc7380-a11f-44c9-83b2-c98c49f07e7b, host hv-cinder-78638, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=32bc7380-a11f-44c9-83b2-c98c49f07e7b,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92013) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 16:47:42.511703 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:42.516176 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-24167663-a7fd-4f53-8954-11f6e8cdd104 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:47:42.572583 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:42.573209 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:42.574631 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] 10.222.0.76 "PUT /v2.0/ports/32bc7380-a11f-44c9-83b2-c98c49f07e7b HTTP/1.1" status: 200  len: 1093 time: 1.1461878
May 25 16:47:42.575034 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'tag': '32bc7380-a11f-44c9-83b2-c98c49f07e7b'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:47:42.594074 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Pushing event updated for resources: {'Port': ['ID=32bc7380-a11f-44c9-83b2-c98c49f07e7b,revision_number=3']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:47:42.597057 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-ac1a11d2-fe47-4ac3-832c-1443c09b1bec service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:47:42.653214 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'tag': '32bc7380-a11f-44c9-83b2-c98c49f07e7b', 'status': 'completed', 'code': 200}
May 25 16:47:42.695016 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-23809dba-8a28-4eee-adb2-c63ad8029d1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:42.696505 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-23809dba-8a28-4eee-adb2-c63ad8029d1b service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 1096 time: 0.0795021
May 25 16:47:42.769327 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-9b57aafa-0837-4776-942f-0772ce2b0b5d service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=32bc7380-a11f-44c9-83b2-c98c49f07e7b HTTP/1.1" status: 200  len: 217 time: 0.0639830
May 25 16:47:42.835443 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-310b78e9-4e8c-4423-9cf1-564768d1290c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:42.836785 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-310b78e9-4e8c-4423-9cf1-564768d1290c service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.0606401
May 25 16:47:42.911676 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-0316d433-644c-4042-8302-5fe8a20adf5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:42.913742 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-0316d433-644c-4042-8302-5fe8a20adf5b service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0697012
May 25 16:47:43.045302 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-5c9d2479-083c-4113-8f1a-c07c4008addd service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1230989
May 25 16:47:43.213457 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-55737ad7-d956-4cb1-ba60-f74e806551eb req-38b566a0-df05-4ed9-a926-a3ec09347538 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1579540
May 25 16:47:43.256056 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d61c91c-4feb-42fc-ab78-214bb8fa7a35 req-0b805fe9-d356-46f6-876c-1afcc82213e2 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:43.257564 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d61c91c-4feb-42fc-ab78-214bb8fa7a35 req-0b805fe9-d356-46f6-876c-1afcc82213e2 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 943 time: 0.0919740
May 25 16:47:43.345905 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1d61c91c-4feb-42fc-ab78-214bb8fa7a35 req-aa44c198-9f0f-4263-b81e-05e78f1325c6 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0553660
May 25 16:47:43.364013 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e4e360-a677-40df-802b-60cdb2feac2b req-14039e92-fefc-46f3-8fc5-076a995345a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:43.366089 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-25e4e360-a677-40df-802b-60cdb2feac2b req-14039e92-fefc-46f3-8fc5-076a995345a7 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 1096 time: 0.1070514
May 25 16:47:43.517576 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e4e360-a677-40df-802b-60cdb2feac2b req-863427be-bf29-46a5-8980-c1334c4a7be7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:43.519008 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-25e4e360-a677-40df-802b-60cdb2feac2b req-863427be-bf29-46a5-8980-c1334c4a7be7 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 913 time: 0.1446695
May 25 16:47:43.593561 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-25e4e360-a677-40df-802b-60cdb2feac2b req-baf416d4-159d-4b21-9a20-369276a13148 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=32bc7380-a11f-44c9-83b2-c98c49f07e7b HTTP/1.1" status: 200  len: 217 time: 0.0645108
May 25 16:47:43.658998 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e4e360-a677-40df-802b-60cdb2feac2b req-d4795e73-abdd-4656-8688-fad4e0c9c967 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:43.660421 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-25e4e360-a677-40df-802b-60cdb2feac2b req-d4795e73-abdd-4656-8688-fad4e0c9c967 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.0578721
May 25 16:47:43.744181 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e4e360-a677-40df-802b-60cdb2feac2b req-cd7c5551-1bb0-47d7-bf5f-a4b171e6b206 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:43.746452 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-25e4e360-a677-40df-802b-60cdb2feac2b req-cd7c5551-1bb0-47d7-bf5f-a4b171e6b206 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0762002
May 25 16:47:43.885781 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-25e4e360-a677-40df-802b-60cdb2feac2b req-2d66c90f-412b-41e1-b882-dca396884f7f service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1251740
May 25 16:47:44.107007 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-25e4e360-a677-40df-802b-60cdb2feac2b req-db1c50b1-0938-44c2-a3d7-ad4be92a3e10 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2102089
May 25 16:47:44.260066 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:44.530854 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca6099c8-209b-4899-991f-fe1f867b73a8 req-fea6ac44-e775-4e67-9d20-b3597fbf01ef tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:44.532112 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ca6099c8-209b-4899-991f-fe1f867b73a8 req-fea6ac44-e775-4e67-9d20-b3597fbf01ef tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 943 time: 0.0782995
May 25 16:47:44.579136 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-ca6099c8-209b-4899-991f-fe1f867b73a8 req-3e15ab32-bd7a-4ba6-9619-ba1ce3764149 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407343
May 25 16:47:45.647903 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7a39a34c-e92c-419e-a001-db457f432480 req-765beb9c-1696-4fa6-ae74-4b0cc0cd4a6f service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0732994
May 25 16:47:45.826557 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-016250dc-743f-4f4f-8b26-06ecee965b3f req-2fad0f4e-8363-4239-8db9-11ac309bac44 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:45.828001 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-016250dc-743f-4f4f-8b26-06ecee965b3f req-2fad0f4e-8363-4239-8db9-11ac309bac44 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 943 time: 0.1426518
May 25 16:47:45.833056 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a39a34c-e92c-419e-a001-db457f432480 req-3b61f680-a24a-4e08-b8d8-ad2826722a4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:45.834457 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7a39a34c-e92c-419e-a001-db457f432480 req-3b61f680-a24a-4e08-b8d8-ad2826722a4c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 1099 time: 0.1101868
May 25 16:47:45.943070 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-016250dc-743f-4f4f-8b26-06ecee965b3f req-afd8b01b-92e4-4ff9-8fa7-368091b54784 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1076920
May 25 16:47:45.994748 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a39a34c-e92c-419e-a001-db457f432480 req-8939aa65-80bb-4001-aef2-5b6e2dead41f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:45.996172 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7a39a34c-e92c-419e-a001-db457f432480 req-8939aa65-80bb-4001-aef2-5b6e2dead41f service neutron] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 913 time: 0.1416802
May 25 16:47:46.102019 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7a39a34c-e92c-419e-a001-db457f432480 req-529c95dc-d4fa-4c6d-9347-9f327aff0f45 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f HTTP/1.1" status: 200  len: 1002 time: 0.0963047
May 25 16:47:46.164074 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a39a34c-e92c-419e-a001-db457f432480 req-f8dd2275-2e27-46f5-857f-51b1389ac15b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:46.165456 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7a39a34c-e92c-419e-a001-db457f432480 req-f8dd2275-2e27-46f5-857f-51b1389ac15b service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.0567214
May 25 16:47:46.243189 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a39a34c-e92c-419e-a001-db457f432480 req-d647ba95-b6ec-4dc8-9cf7-54193c5ada33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:46.244538 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7a39a34c-e92c-419e-a001-db457f432480 req-d647ba95-b6ec-4dc8-9cf7-54193c5ada33 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0722191
May 25 16:47:46.375848 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7a39a34c-e92c-419e-a001-db457f432480 req-76be5599-033b-4aa0-9276-488da9f47866 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1224563
May 25 16:47:46.506746 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7a39a34c-e92c-419e-a001-db457f432480 req-4b481126-8fb9-4ed3-8498-e040863ce3e1 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1228154
May 25 16:47:47.123471 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46147052-32fb-4fb4-8dd7-7c65e60952cf req-549e32de-e462-4c87-950a-d15c7e06f8c8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:47.125053 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-46147052-32fb-4fb4-8dd7-7c65e60952cf req-549e32de-e462-4c87-950a-d15c7e06f8c8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 943 time: 0.0794156
May 25 16:47:47.169977 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-46147052-32fb-4fb4-8dd7-7c65e60952cf req-ff7a605f-128a-4392-a24e-114d2da4728b tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393312
May 25 16:47:48.357651 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a7083c5-2f18-4c69-a1f0-c5bf94c75fcc req-6bc407b7-e911-40b7-ba89-056b8f251d0f tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:48.359130 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8a7083c5-2f18-4c69-a1f0-c5bf94c75fcc req-6bc407b7-e911-40b7-ba89-056b8f251d0f tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 943 time: 0.0831988
May 25 16:47:48.418412 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8a7083c5-2f18-4c69-a1f0-c5bf94c75fcc req-cf35fe0d-7e31-4ba1-b3bb-3ecc81fd4d07 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0537007
May 25 16:47:49.610321 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3be617a9-fc5f-4921-99a3-ac7273cdfdbf req-bd730d58-166a-4aec-861e-0d386504b508 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:49.612042 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3be617a9-fc5f-4921-99a3-ac7273cdfdbf req-bd730d58-166a-4aec-861e-0d386504b508 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 943 time: 0.0815980
May 25 16:47:49.659343 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-3be617a9-fc5f-4921-99a3-ac7273cdfdbf req-9e526c0c-a4a4-4475-b6d1-c35827231d9b tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0416124
May 25 16:47:50.842020 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b9337d0-787c-43c8-b88d-4b9839dc048e req-42676337-b146-4b14-a8d4-ee1a032bdaef tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:50.843392 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7b9337d0-787c-43c8-b88d-4b9839dc048e req-42676337-b146-4b14-a8d4-ee1a032bdaef tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 943 time: 0.0784442
May 25 16:47:50.887390 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7b9337d0-787c-43c8-b88d-4b9839dc048e req-6cf1c153-be24-4b04-b4e1-fac8bbdd06d3 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385118
May 25 16:47:51.791609 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 32bc7380-a11f-44c9-83b2-c98c49f07e7b details requested by agent hyperv_hv-cinder-78638 with host hv-cinder-78638 {{(pid=92014) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 16:47:51.922210 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 32bc7380-a11f-44c9-83b2-c98c49f07e7b, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=32bc7380-a11f-44c9-83b2-c98c49f07e7b,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:47:51.935998 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Returning: {'device': '32bc7380-a11f-44c9-83b2-c98c49f07e7b', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'port_id': '32bc7380-a11f-44c9-83b2-c98c49f07e7b', 'mac_address': 'fa:16:3e:80:f7:3d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 435, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92014) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 16:47:51.990475 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:52.007663 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 32bc7380-a11f-44c9-83b2-c98c49f07e7b {{(pid=92014) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 16:47:52.022383 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 32bc7380-a11f-44c9-83b2-c98c49f07e7b, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=32bc7380-a11f-44c9-83b2-c98c49f07e7b,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:47:52.026602 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:52.029315 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-3b8148c1-04d2-406d-92fe-afe58f31445e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:47:52.075282 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9a66ba-0c31-4b9e-96b2-3b2781f0b510 req-10845c63-78ba-4028-a5d1-03619854eceb tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:52.076638 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bc9a66ba-0c31-4b9e-96b2-3b2781f0b510 req-10845c63-78ba-4028-a5d1-03619854eceb tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 944 time: 0.0834579
May 25 16:47:52.097691 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=32bc7380-a11f-44c9-83b2-c98c49f07e7b,revision_number=4']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:47:52.105200 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:52.105566 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:52.105901 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:52.106225 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:52.106541 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:52.106861 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:52.107276 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:52.107596 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:52.107911 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:52.108219 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:52.108524 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:52.108832 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:47:52.112640 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:47:52.121203 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-bc9a66ba-0c31-4b9e-96b2-3b2781f0b510 req-748fa1d0-1984-43e3-a9a5-3b7fe0614e9f tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0386536
May 25 16:47:52.334985 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] get_ports_and_sgs() called for port_ids ['32bc7380-a11f-44c9-83b2-c98c49f07e7b'] {{(pid=92014) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 16:47:53.309051 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0414e2d6-6dd4-4b52-8968-66e9ea09f41a req-062a4042-fffd-44ce-8240-61024ad6a347 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:53.310500 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0414e2d6-6dd4-4b52-8968-66e9ea09f41a req-062a4042-fffd-44ce-8240-61024ad6a347 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 944 time: 0.0869272
May 25 16:47:53.354126 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-0414e2d6-6dd4-4b52-8968-66e9ea09f41a req-a61e9c48-5efc-443e-b7cb-94c44990eb26 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0379708
May 25 16:47:53.803095 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 32bc7380-a11f-44c9-83b2-c98c49f07e7b up at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 16:47:53.872140 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning for port 32bc7380-a11f-44c9-83b2-c98c49f07e7b completed by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 16:47:53.876881 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.provisioning_blocks [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Provisioning complete for port 32bc7380-a11f-44c9-83b2-c98c49f07e7b triggered by entity L2. {{(pid=92014) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 16:47:53.877250 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1546813'] for port, provisioning_complete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:53.989588 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:54.016776 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '32bc7380-a11f-44c9-83b2-c98c49f07e7b'}] {{(pid=92014) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:47:54.026040 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] For port 32bc7380-a11f-44c9-83b2-c98c49f07e7b, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=32bc7380-a11f-44c9-83b2-c98c49f07e7b,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:47:54.030570 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582'] for port, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:54.032369 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-450046c1-0fe9-4ac0-9035-a096be8ab679 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:47:54.070092 dv-cinder-786386-6-iscsi neutron-server[92014]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '32bc7380-a11f-44c9-83b2-c98c49f07e7b', 'code': 200}
May 25 16:47:54.101206 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Pushing event updated for resources: {'Port': ['ID=32bc7380-a11f-44c9-83b2-c98c49f07e7b,revision_number=5']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:47:54.103988 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:47:54.451486 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48a22dc-3aa9-4093-8499-ad6dd8c2ac64 req-2825afd3-9595-486d-b785-d5d75db36e1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:54.453047 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d48a22dc-3aa9-4093-8499-ad6dd8c2ac64 req-2825afd3-9595-486d-b785-d5d75db36e1c service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 1098 time: 0.1673369
May 25 16:47:54.544851 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d48a22dc-3aa9-4093-8499-ad6dd8c2ac64 req-d038bb6a-35d9-4da3-bbcd-ab01e9c64a68 service neutron] 10.222.0.76 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0827503
May 25 16:47:54.569661 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cee0b14-6744-4eb7-bb42-315f490b89c8 req-478e89e4-0497-4c8d-9dd8-903e1efb5a8c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:54.571055 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7cee0b14-6744-4eb7-bb42-315f490b89c8 req-478e89e4-0497-4c8d-9dd8-903e1efb5a8c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 945 time: 0.0970414
May 25 16:47:54.618379 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-7cee0b14-6744-4eb7-bb42-315f490b89c8 req-d8ab7f05-8f5e-45f4-aeee-a671ea117d57 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0416548
May 25 16:47:55.803199 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfff291b-4e98-4018-8c5c-f126d5bda7eb req-90e6eb9d-e55a-44a0-ad8a-7b2c993d5b54 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:55.804654 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dfff291b-4e98-4018-8c5c-f126d5bda7eb req-90e6eb9d-e55a-44a0-ad8a-7b2c993d5b54 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 945 time: 0.0785394
May 25 16:47:55.849010 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-dfff291b-4e98-4018-8c5c-f126d5bda7eb req-afd36242-1124-49fc-91d6-609616b07f87 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0382044
May 25 16:47:56.034916 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e33980-34de-49b0-b7c3-87fb94f363c4 req-34a2e5e3-3b1a-44c2-bca0-dc41cf77566a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:56.036235 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-82e33980-34de-49b0-b7c3-87fb94f363c4 req-34a2e5e3-3b1a-44c2-bca0-dc41cf77566a tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 945 time: 0.0828683
May 25 16:47:56.079244 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-82e33980-34de-49b0-b7c3-87fb94f363c4 req-a5f86f6a-568e-47e6-ad63-4e17d5a03c92 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0375113
May 25 16:47:56.102692 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33726) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:47:56.172442 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a274e341-d9c1-491d-ad1e-4f54a6a95b4f tempest-TestVolumeBootPattern-836350970 tempest-TestVolumeBootPattern-836350970-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:56.173949 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-a274e341-d9c1-491d-ad1e-4f54a6a95b4f tempest-TestVolumeBootPattern-836350970 tempest-TestVolumeBootPattern-836350970-project-admin] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 1093 time: 0.0703087
May 25 16:47:56.176659 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33730) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:47:56.182207 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.v2.base [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Request body: {'floatingip': {'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'port_id': '32bc7380-a11f-44c9-83b2-c98c49f07e7b', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address': '172.20.0.8'}} {{(pid=92013) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 16:47:56.189751 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 16:47:56.196604 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Usage tracker for resource:floatingip and tenant:577d706beb414387a68972cf7e8d0285 is out of sync, need to count used quota {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 16:47:56.199834 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=92013) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 16:47:56.207301 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.quota.driver [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=92013) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 16:47:56.218187 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for floatingip, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:56.351748 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:56.486510 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_common [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Allocated IP 172.27.3.168 (fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb/772b799b-fb95-46a6-ab51-ab34127985e2/ee9c0ab5-ee37-4a95-a12a-ece63f8e6b13) {{(pid=92013) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 16:47:56.637305 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for port, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:56.666074 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8741446017235', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:56.670348 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-69b3bc7e-b6df-4fc8-88e4-76008d21c94f tempest-AttachVolumeShelveTestJSON-1560668212 tempest-AttachVolumeShelveTestJSON-1560668212-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:47:56.728970 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Network fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb is already hosted by enough agents. {{(pid=92013) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 16:47:56.731755 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.base_scheduler [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Resources bound (agent type, host, resource id):  {{(pid=92013) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 16:47:56.735469 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Received port after_create {{(pid=92013) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 16:47:56.774241 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'Port': ['ID=ee9c0ab5-ee37-4a95-a12a-ece63f8e6b13,revision_number=1']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:47:56.778256 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:47:57.145227 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:57.217077 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-576523'] for port, before_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:57.418517 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for port, precommit_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:57.422834 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8741446402196', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8741446017253', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8741446018582', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7025806'] for port, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:57.426357 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-31eaebef-ca0b-41a2-a82e-0265cca03a01 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:47:57.625584 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event updated for resources: {'Port': ['ID=ee9c0ab5-ee37-4a95-a12a-ece63f8e6b13,revision_number=2']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:47:57.629481 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:47:57.636477 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-501018'] for floatingip, after_update {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:57.811201 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.db.l3_db [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Floating IP 78ddbb83-316f-42a9-9324-b28958990a35 associated. External IP: 172.27.3.168, port: 32bc7380-a11f-44c9-83b2-c98c49f07e7b.
May 25 16:47:58.156817 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Router 3ec8f109-cb75-4f41-81bd-ca78638538c9 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:47:58.333621 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:47:58.343136 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-683aa799-8cae-46c3-b0c1-cb13739b99b5 None None] Sync routers for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:47:58.352472 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-683aa799-8cae-46c3-b0c1-cb13739b99b5 None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:47:58.353078 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-683aa799-8cae-46c3-b0c1-cb13739b99b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346ab65760>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:47:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:47:58.358284 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:47:58.417834 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.2400434
May 25 16:47:58.418522 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'tag': '32bc7380-a11f-44c9-83b2-c98c49f07e7b'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:47:58.522017 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'tag': '32bc7380-a11f-44c9-83b2-c98c49f07e7b', 'status': 'completed', 'code': 200}
May 25 16:47:58.579906 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-683aa799-8cae-46c3-b0c1-cb13739b99b5 None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:47:58.630736 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91515b9-e11c-4120-8ec1-cca587fc1a57 req-1544e957-ecdb-4dc6-aafa-9235fe5edace service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:58.632266 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c91515b9-e11c-4120-8ec1-cca587fc1a57 req-1544e957-ecdb-4dc6-aafa-9235fe5edace service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 1098 time: 0.0742228
May 25 16:47:58.767748 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91515b9-e11c-4120-8ec1-cca587fc1a57 req-2f240baa-08e7-4ef0-b47c-d0f0aaf09033 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:58.769305 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c91515b9-e11c-4120-8ec1-cca587fc1a57 req-2f240baa-08e7-4ef0-b47c-d0f0aaf09033 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 913 time: 0.1283495
May 25 16:47:58.879559 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c91515b9-e11c-4120-8ec1-cca587fc1a57 req-92e19ae6-fec9-4a92-8221-00d49785ffb1 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=32bc7380-a11f-44c9-83b2-c98c49f07e7b HTTP/1.1" status: 200  len: 999 time: 0.1000738
May 25 16:47:58.934294 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-683aa799-8cae-46c3-b0c1-cb13739b99b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346ab65760>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '78ddbb83-316f-42a9-9324-b28958990a35', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.168', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': '32bc7380-a11f-44c9-83b2-c98c49f07e7b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:80:f7:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:47:57Z', 'updated_at': '2021-05-25T16:47:57Z', 'revision_number': 0, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}, {'id': 'c671a6ec-38d9-408e-bfd3-14267b94e234', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.238', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 663, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:fe:c5:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:45:38Z', 'updated_at': '2021-05-25T16:45:41Z', 'revision_number': 1, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:47:58.938192 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-683aa799-8cae-46c3-b0c1-cb13739b99b5 None None] Checking router: 3ec8f109-cb75-4f41-81bd-ca78638538c9 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:47:58.941447 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91515b9-e11c-4120-8ec1-cca587fc1a57 req-730b7d1d-99c2-4e75-a535-046d36d44f1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:58.942875 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c91515b9-e11c-4120-8ec1-cca587fc1a57 req-730b7d1d-99c2-4e75-a535-046d36d44f1c service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.0562577
May 25 16:47:58.946607 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-683aa799-8cae-46c3-b0c1-cb13739b99b5 None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:47:58.947202 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-683aa799-8cae-46c3-b0c1-cb13739b99b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346ab65760>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:47:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:47:59.020089 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91515b9-e11c-4120-8ec1-cca587fc1a57 req-a87ff045-16e8-4b9e-9ab2-927279ac1923 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:47:59.021547 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c91515b9-e11c-4120-8ec1-cca587fc1a57 req-a87ff045-16e8-4b9e-9ab2-927279ac1923 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0696709
May 25 16:47:59.133259 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-683aa799-8cae-46c3-b0c1-cb13739b99b5 None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:47:59.265197 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c91515b9-e11c-4120-8ec1-cca587fc1a57 req-d24ffb06-9977-48a6-9942-7494122278b1 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2358558
May 25 16:47:59.401336 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-c91515b9-e11c-4120-8ec1-cca587fc1a57 req-dd965982-8c3f-48d8-aa6a-0b9c5d5d981a service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1252482
May 25 16:47:59.491655 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-683aa799-8cae-46c3-b0c1-cb13739b99b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346ab65760>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '78ddbb83-316f-42a9-9324-b28958990a35', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.168', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': '32bc7380-a11f-44c9-83b2-c98c49f07e7b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:80:f7:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:47:57Z', 'updated_at': '2021-05-25T16:47:57Z', 'revision_number': 0, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}, {'id': 'c671a6ec-38d9-408e-bfd3-14267b94e234', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.238', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 663, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:fe:c5:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:45:38Z', 'updated_at': '2021-05-25T16:45:41Z', 'revision_number': 1, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:47:59.495525 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-683aa799-8cae-46c3-b0c1-cb13739b99b5 None None] The sync data for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi is: [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': '78ddbb83-316f-42a9-9324-b28958990a35', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.168', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': '32bc7380-a11f-44c9-83b2-c98c49f07e7b', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:80:f7:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:47:57Z', 'updated_at': '2021-05-25T16:47:57Z', 'revision_number': 0, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}, {'id': 'c671a6ec-38d9-408e-bfd3-14267b94e234', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.238', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 663, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:fe:c5:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:45:38Z', 'updated_at': '2021-05-25T16:45:41Z', 'revision_number': 1, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:47:59.685095 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0d45ea6-1e24-4c6b-b7d8-be9c6273e138 None None] New status for floating IP 78ddbb83-316f-42a9-9324-b28958990a35: ACTIVE {{(pid=92015) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:48:01.432226 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-78e87177-0a92-41e6-aa92-6f598cd12ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:48:03.857781 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:48:04.115660 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-a6b82d21-0cfb-4add-95a3-752feda9fb23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:48:05.083773 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:48:06.602705 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:48:14.282619 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:48:17.625192 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:48:31.435019 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4a192533-7b25-4b6a-bbf0-7579e0d72aa1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:48:33.860550 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:48:34.117063 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-9defe640-811d-4aa4-beb5-81fbd0becf44 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:48:35.087058 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:48:36.613963 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:48:44.314816 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:48:46.656293 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5efad5b0-ab30-47ea-a686-9cccfba9f459 req-60d3e346-e4fa-47a0-8f4a-f0c876accc55 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0751581
May 25 16:48:46.797510 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5efad5b0-ab30-47ea-a686-9cccfba9f459 req-585eb590-30ef-4c4a-b493-70a273e54c7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:48:46.798982 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5efad5b0-ab30-47ea-a686-9cccfba9f459 req-585eb590-30ef-4c4a-b493-70a273e54c7c service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 1099 time: 0.0726447
May 25 16:48:46.950520 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5efad5b0-ab30-47ea-a686-9cccfba9f459 req-5b6d2673-31ac-4c27-a18e-4cd146a0cd4e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:48:46.951968 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5efad5b0-ab30-47ea-a686-9cccfba9f459 req-5b6d2673-31ac-4c27-a18e-4cd146a0cd4e service neutron] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 913 time: 0.1306527
May 25 16:48:47.067260 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5efad5b0-ab30-47ea-a686-9cccfba9f459 req-850fdff5-a0bd-4f7b-9508-6113a9dbe69a service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f HTTP/1.1" status: 200  len: 1002 time: 0.1069183
May 25 16:48:47.133806 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5efad5b0-ab30-47ea-a686-9cccfba9f459 req-8bcfc340-efc1-4d91-a4c9-8063bfd4d300 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:48:47.135257 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5efad5b0-ab30-47ea-a686-9cccfba9f459 req-8bcfc340-efc1-4d91-a4c9-8063bfd4d300 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.0609841
May 25 16:48:47.219921 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5efad5b0-ab30-47ea-a686-9cccfba9f459 req-5536ca7c-2004-4e36-9051-32e9eb18e616 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:48:47.221327 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5efad5b0-ab30-47ea-a686-9cccfba9f459 req-5536ca7c-2004-4e36-9051-32e9eb18e616 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0780997
May 25 16:48:47.356416 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5efad5b0-ab30-47ea-a686-9cccfba9f459 req-41a11a88-9821-41ee-98d9-0216f98a30f9 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1276374
May 25 16:48:47.497461 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5efad5b0-ab30-47ea-a686-9cccfba9f459 req-56a71ae6-6db6-49d4-b2ad-afd7e46f4228 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1330302
May 25 16:48:54.653901 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:49:01.437958 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d2cdf93a-3db5-4af4-a724-0d4f07b84021 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:03.862340 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:04.118118 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-a42cd320-4ab8-4a85-814f-55cde54d77c8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:05.090361 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:06.612490 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:14.323036 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:31.440386 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-f5e5e97c-70a6-41fb-9bd7-c8942f613563 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:31.623065 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:49:33.864417 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:34.120160 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c24519df-0f40-4a2b-aa89-d1ad3c57bb15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:35.094523 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:36.613152 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:37.768157 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33762) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:49:38.165887 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Deleting port ee9c0ab5-ee37-4a95-a12a-ece63f8e6b13 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:49:38.166255 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:38.288594 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:38.288910 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:38.415026 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Calling delete_port for ee9c0ab5-ee37-4a95-a12a-ece63f8e6b13 owned by network:floatingip {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:49:38.541321 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:38.545031 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2bb6e78b-898a-43ae-b9bf-89fb13186989 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:49:38.589362 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event deleted for resources: {'Port': ['ID=ee9c0ab5-ee37-4a95-a12a-ece63f8e6b13,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:49:38.627383 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:38.627768 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:38.628141 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:38.628510 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:38.628880 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:38.629248 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:38.629639 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:38.630004 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:38.630365 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:38.630725 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:38.631101 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:38.631440 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92012) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:38.638651 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:49:38.696431 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for floatingip, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:38.696704 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.l3_db [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Floating IP 78ddbb83-316f-42a9-9324-b28958990a35 disassociated (deleted). External IP: 172.27.3.168, port: 32bc7380-a11f-44c9-83b2-c98c49f07e7b.
May 25 16:49:39.067502 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Router 3ec8f109-cb75-4f41-81bd-ca78638538c9 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:49:39.258902 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:49:39.269047 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6eeda78-f4be-4cff-9952-61c6c93d3b7d None None] Sync routers for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:49:39.279976 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6eeda78-f4be-4cff-9952-61c6c93d3b7d None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:49:39.281293 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-c6eeda78-f4be-4cff-9952-61c6c93d3b7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b95a100>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:49:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:39.294130 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:39.350103 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "DELETE /v2.0/floatingips/78ddbb83-316f-42a9-9324-b28958990a35 HTTP/1.1" status: 204  len: 168 time: 1.5807731
May 25 16:49:39.350677 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'tag': '32bc7380-a11f-44c9-83b2-c98c49f07e7b'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:49:39.461264 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'tag': '32bc7380-a11f-44c9-83b2-c98c49f07e7b', 'status': 'completed', 'code': 200}
May 25 16:49:39.473183 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-c6eeda78-f4be-4cff-9952-61c6c93d3b7d None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:49:39.576546 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b19ab38-ba5c-4cd5-9950-e48c47508bae req-44356de9-7779-4f2e-8f6d-e8a5e9c95254 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:39.580459 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1b19ab38-ba5c-4cd5-9950-e48c47508bae req-44356de9-7779-4f2e-8f6d-e8a5e9c95254 service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 1098 time: 0.0938370
May 25 16:49:39.783296 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b19ab38-ba5c-4cd5-9950-e48c47508bae req-07cdcfe9-a486-4530-938f-16b5e72024e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:39.784738 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1b19ab38-ba5c-4cd5-9950-e48c47508bae req-07cdcfe9-a486-4530-938f-16b5e72024e3 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 913 time: 0.1903389
May 25 16:49:39.859477 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1b19ab38-ba5c-4cd5-9950-e48c47508bae req-aedce2db-22fd-4d25-89f7-6885ae614c72 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=32bc7380-a11f-44c9-83b2-c98c49f07e7b HTTP/1.1" status: 200  len: 217 time: 0.0673623
May 25 16:49:39.868138 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71e35fb7-e690-40ec-9f29-2702fcfd8940 req-f6783944-1028-4b82-a5f7-390dab292c02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:39.869575 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71e35fb7-e690-40ec-9f29-2702fcfd8940 req-f6783944-1028-4b82-a5f7-390dab292c02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 945 time: 0.1875331
May 25 16:49:39.905970 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-c6eeda78-f4be-4cff-9952-61c6c93d3b7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b95a100>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': 'c671a6ec-38d9-408e-bfd3-14267b94e234', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.238', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 663, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:fe:c5:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:45:38Z', 'updated_at': '2021-05-25T16:45:41Z', 'revision_number': 1, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:39.911072 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6eeda78-f4be-4cff-9952-61c6c93d3b7d None None] Checking router: 3ec8f109-cb75-4f41-81bd-ca78638538c9 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:49:39.919722 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6eeda78-f4be-4cff-9952-61c6c93d3b7d None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:49:39.920972 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-c6eeda78-f4be-4cff-9952-61c6c93d3b7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b95a100>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:49:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:39.963924 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71e35fb7-e690-40ec-9f29-2702fcfd8940 req-3700c572-f2e1-4743-9604-213b58437791 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0619385
May 25 16:49:39.965445 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b19ab38-ba5c-4cd5-9950-e48c47508bae req-558acc6e-7e35-407c-9004-38653ff09489 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:39.966839 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1b19ab38-ba5c-4cd5-9950-e48c47508bae req-558acc6e-7e35-407c-9004-38653ff09489 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.0963793
May 25 16:49:40.111602 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-c6eeda78-f4be-4cff-9952-61c6c93d3b7d None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:49:40.148519 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b19ab38-ba5c-4cd5-9950-e48c47508bae req-f73bd9a9-a908-412a-9592-f7d5f8f11344 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:40.150207 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1b19ab38-ba5c-4cd5-9950-e48c47508bae req-f73bd9a9-a908-412a-9592-f7d5f8f11344 service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1737249
May 25 16:49:40.286071 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1b19ab38-ba5c-4cd5-9950-e48c47508bae req-c78e0195-850e-4d60-a2e4-e76afb1175db service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1269965
May 25 16:49:40.430331 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-1b19ab38-ba5c-4cd5-9950-e48c47508bae req-88e1871b-d6c8-4083-8d7d-0ac1bc65e036 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1369398
May 25 16:49:40.472672 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-c6eeda78-f4be-4cff-9952-61c6c93d3b7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b95a100>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': 'c671a6ec-38d9-408e-bfd3-14267b94e234', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.238', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 663, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:fe:c5:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:45:38Z', 'updated_at': '2021-05-25T16:45:41Z', 'revision_number': 1, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:40.476698 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6eeda78-f4be-4cff-9952-61c6c93d3b7d None None] The sync data for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi is: [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_floatingips': [{'id': 'c671a6ec-38d9-408e-bfd3-14267b94e234', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'floating_ip_address': '172.27.3.238', 'floating_network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'router_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'port_id': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 663, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'mac_address': 'fa:16:3e:fe:c5:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T16:45:38Z', 'updated_at': '2021-05-25T16:45:41Z', 'revision_number': 1, 'project_id': '577d706beb414387a68972cf7e8d0285', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:49:40.692932 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7c712bd-2b59-4e46-9bfc-8e6dc822da69 None None] New status for floating IP 78ddbb83-316f-42a9-9324-b28958990a35: DOWN {{(pid=92015) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:49:41.167292 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71ad68cc-ce53-4f47-b4bd-6d9c277f5523 req-d50d26c4-726c-47f4-baca-9419ebb7b38e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:41.168768 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71ad68cc-ce53-4f47-b4bd-6d9c277f5523 req-d50d26c4-726c-47f4-baca-9419ebb7b38e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 945 time: 0.0805051
May 25 16:49:41.216262 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-71ad68cc-ce53-4f47-b4bd-6d9c277f5523 req-c7749108-c8ff-4461-a6c1-eed8a815046c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0417521
May 25 16:49:41.337160 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5108e6a-1415-4343-a8bd-eb2dda7825b2 req-1dd76876-f935-488e-930c-720dba5b4c07 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:41.338491 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d5108e6a-1415-4343-a8bd-eb2dda7825b2 req-1dd76876-f935-488e-930c-720dba5b4c07 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 945 time: 0.0827880
May 25 16:49:41.476970 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-d5108e6a-1415-4343-a8bd-eb2dda7825b2 req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Deleting port 32bc7380-a11f-44c9-83b2-c98c49f07e7b {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:49:41.477300 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d5108e6a-1415-4343-a8bd-eb2dda7825b2 req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:41.618508 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-d5108e6a-1415-4343-a8bd-eb2dda7825b2 req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] For port 32bc7380-a11f-44c9-83b2-c98c49f07e7b, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=32bc7380-a11f-44c9-83b2-c98c49f07e7b,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:49:41.618863 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d5108e6a-1415-4343-a8bd-eb2dda7825b2 req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:41.742662 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-d5108e6a-1415-4343-a8bd-eb2dda7825b2 req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Calling delete_port for 32bc7380-a11f-44c9-83b2-c98c49f07e7b owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:49:41.856328 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d5108e6a-1415-4343-a8bd-eb2dda7825b2 req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:41.862936 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-bd39e470-6ae0-4d4d-878b-1d4055c6940c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:49:41.923258 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event deleted for resources: {'Port': ['ID=32bc7380-a11f-44c9-83b2-c98c49f07e7b,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:49:41.990581 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:41.990949 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:41.991305 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:41.991657 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:41.992009 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:41.992356 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:41.992708 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:41.993051 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:41.993392 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:41.993755 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:41.994092 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:41.994431 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92013) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:42.001706 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:49:42.007825 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-d5108e6a-1415-4343-a8bd-eb2dda7825b2 req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] No DVR routers for this DVR port 32bc7380-a11f-44c9-83b2-c98c49f07e7b on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:49:42.011372 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-d5108e6a-1415-4343-a8bd-eb2dda7825b2 req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:42.013996 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'name': 'network-vif-deleted', 'tag': '32bc7380-a11f-44c9-83b2-c98c49f07e7b'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:49:42.025383 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d5108e6a-1415-4343-a8bd-eb2dda7825b2 req-b87c7000-be23-4c30-bd9b-042488a14625 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "DELETE /v2.0/ports/32bc7380-a11f-44c9-83b2-c98c49f07e7b HTTP/1.1" status: 204  len: 173 time: 0.6790740
May 25 16:49:42.061729 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9b5199d1-ed35-4c38-976a-d79e9ccc41a1', 'name': 'network-vif-deleted', 'tag': '32bc7380-a11f-44c9-83b2-c98c49f07e7b', 'status': 'completed', 'code': 200}
May 25 16:49:42.373246 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-4b7b664e-d8f4-4a7d-9e1c-92d00154186f req-b9afb9df-c8be-4bc1-9d7b-06dbab4beb95 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Synchronizing usage tracker for tenant:577d706beb414387a68972cf7e8d0285 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:49:42.391975 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-4b7b664e-d8f4-4a7d-9e1c-92d00154186f req-b9afb9df-c8be-4bc1-9d7b-06dbab4beb95 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Unset dirty status for tenant:577d706beb414387a68972cf7e8d0285 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:49:42.394008 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-4b7b664e-d8f4-4a7d-9e1c-92d00154186f req-b9afb9df-c8be-4bc1-9d7b-06dbab4beb95 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=9b5199d1-ed35-4c38-976a-d79e9ccc41a1 HTTP/1.1" status: 200  len: 210 time: 0.0699310
May 25 16:49:44.332304 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:45.901271 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33796) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:49:46.291785 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Deleting port 70ebe568-64ee-4e64-8261-c10615c9ac85 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:49:46.292071 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:46.413815 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:46.414151 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:46.439341 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 32bc7380-a11f-44c9-83b2-c98c49f07e7b no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:49:46.474998 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: 32bc7380-a11f-44c9-83b2-c98c49f07e7b {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:49:46.475340 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device 32bc7380-a11f-44c9-83b2-c98c49f07e7b not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:49:46.544509 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Calling delete_port for 70ebe568-64ee-4e64-8261-c10615c9ac85 owned by network:floatingip {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:49:46.672830 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:46.676505 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-77853bc1-1cda-4b7e-9b41-97e97947066f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:49:46.722014 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event deleted for resources: {'Port': ['ID=70ebe568-64ee-4e64-8261-c10615c9ac85,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:49:46.747795 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:49:46.822079 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for floatingip, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:46.822531 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.db.l3_db [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Floating IP c671a6ec-38d9-408e-bfd3-14267b94e234 disassociated (deleted). External IP: 172.27.3.238, port: f34c5bea-0865-4c2c-bcd1-2f43a4456e7f.
May 25 16:49:47.177021 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Router 3ec8f109-cb75-4f41-81bd-ca78638538c9 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92012) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:49:47.367885 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92012) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:49:47.381257 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b477e032-93cc-4f79-9ca1-971e5efcda7f None None] Sync routers for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:49:47.392225 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:47.398889 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b477e032-93cc-4f79-9ca1-971e5efcda7f None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:49:47.400360 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-b477e032-93cc-4f79-9ca1-971e5efcda7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346abc9d90>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:49:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:47.448230 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-68a924ef-fcd1-469f-9f72-823c224efabe tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "DELETE /v2.0/floatingips/c671a6ec-38d9-408e-bfd3-14267b94e234 HTTP/1.1" status: 204  len: 168 time: 1.5457649
May 25 16:49:47.448898 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'tag': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f'}] {{(pid=92012) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:49:47.499141 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'tag': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'status': 'completed', 'code': 200}
May 25 16:49:47.597252 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e06e62e-aa15-4bec-8994-3e9a498f8d83 req-45f9b4d6-a68d-4ebc-a6b4-fe684d730e3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:47.598822 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5e06e62e-aa15-4bec-8994-3e9a498f8d83 req-45f9b4d6-a68d-4ebc-a6b4-fe684d730e3e service neutron] 10.222.0.76 "GET /v2.0/ports?tenant_id=577d706beb414387a68972cf7e8d0285&device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 1099 time: 0.0774264
May 25 16:49:47.617799 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-b477e032-93cc-4f79-9ca1-971e5efcda7f None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:49:47.753709 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e06e62e-aa15-4bec-8994-3e9a498f8d83 req-ec748670-3099-4f9f-9c11-bcb1b3492391 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:47.755069 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5e06e62e-aa15-4bec-8994-3e9a498f8d83 req-ec748670-3099-4f9f-9c11-bcb1b3492391 service neutron] 10.222.0.76 "GET /v2.0/networks?id=9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 200  len: 913 time: 0.1489205
May 25 16:49:47.864343 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5e06e62e-aa15-4bec-8994-3e9a498f8d83 req-fce6cb12-ff9f-42ed-9a9e-ad0435d8e469 service neutron] 10.222.0.76 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f HTTP/1.1" status: 200  len: 217 time: 0.0760131
May 25 16:49:48.004519 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-b477e032-93cc-4f79-9ca1-971e5efcda7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346abc9d90>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:48.008604 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b477e032-93cc-4f79-9ca1-971e5efcda7f None None] Checking router: 3ec8f109-cb75-4f41-81bd-ca78638538c9 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:49:48.017104 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b477e032-93cc-4f79-9ca1-971e5efcda7f None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:49:48.017750 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-b477e032-93cc-4f79-9ca1-971e5efcda7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346abc9d90>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:49:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:48.043190 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e06e62e-aa15-4bec-8994-3e9a498f8d83 req-c2148a98-f37c-42c2-ac1e-0efef888d3f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:48.044607 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5e06e62e-aa15-4bec-8994-3e9a498f8d83 req-c2148a98-f37c-42c2-ac1e-0efef888d3f0 service neutron] 10.222.0.76 "GET /v2.0/subnets?id=2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 200  len: 851 time: 0.1720686
May 25 16:49:48.056519 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cc50d0a-f7b3-4b18-a5fb-e4eba3ab6ca0 req-ad440929-a4da-4000-9930-71229430249e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:48.057951 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8cc50d0a-f7b3-4b18-a5fb-e4eba3ab6ca0 req-ad440929-a4da-4000-9930-71229430249e tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 946 time: 0.3001904
May 25 16:49:48.154451 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-8cc50d0a-f7b3-4b18-a5fb-e4eba3ab6ca0 req-0256df76-f0d9-4a69-bb87-dd09156d70d9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0651641
May 25 16:49:48.182719 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e06e62e-aa15-4bec-8994-3e9a498f8d83 req-f035b396-e58c-4a11-8af3-163f96dfef2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:48.184406 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5e06e62e-aa15-4bec-8994-3e9a498f8d83 req-f035b396-e58c-4a11-8af3-163f96dfef2d service neutron] 10.222.0.76 "GET /v2.0/ports?network_id=9c8cc949-bd51-40a0-bff3-5527e7341361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1255817
May 25 16:49:48.202398 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-b477e032-93cc-4f79-9ca1-971e5efcda7f None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:49:48.322995 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5e06e62e-aa15-4bec-8994-3e9a498f8d83 req-ca4150a4-cbd6-4c8a-8e60-ea07f7429b78 service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1313848
May 25 16:49:48.461682 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-5e06e62e-aa15-4bec-8994-3e9a498f8d83 req-6ac21bf3-9e20-43b6-bf28-74c421b3ccfc service neutron] 10.222.0.76 "GET /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1297081
May 25 16:49:48.526028 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-b477e032-93cc-4f79-9ca1-971e5efcda7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346abc9d90>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:48.530015 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b477e032-93cc-4f79-9ca1-971e5efcda7f None None] The sync data for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi is: [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:42:04Z', 'revision_number': 4, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi', '_interfaces': [{'id': '98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1', 'name': '', 'network_id': '9c8cc949-bd51-40a0-bff3-5527e7341361', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'mac_address': 'fa:16:3e:26:45:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_interface', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:03Z', 'updated_at': '2021-05-25T16:42:12Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'subnets': [{'id': '2f2f7850-0dc5-48dc-8602-816147b64784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:49:48.748135 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7345c7f-ec79-4399-8a8b-92bd41fd041d None None] New status for floating IP c671a6ec-38d9-408e-bfd3-14267b94e234: DOWN {{(pid=92015) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 16:49:49.400685 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1d10c7-5912-4c06-a234-4d0beb9c5031 req-ba06fa50-874b-40bf-894b-5f704ec566d0 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:49.402147 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-db1d10c7-5912-4c06-a234-4d0beb9c5031 req-ba06fa50-874b-40bf-894b-5f704ec566d0 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 946 time: 0.1089880
May 25 16:49:49.414558 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-929cc684-da0e-420c-9dd8-65e1c4f02aa8 req-27c7fa9b-ec87-4e19-9def-34717b249dca tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92013) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 16:49:49.415954 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-929cc684-da0e-420c-9dd8-65e1c4f02aa8 req-27c7fa9b-ec87-4e19-9def-34717b249dca tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 946 time: 0.1543677
May 25 16:49:49.541438 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-929cc684-da0e-420c-9dd8-65e1c4f02aa8 req-3a73cc77-1af4-44f2-82cd-bc6997301a6c tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/security-groups?id=63866e13-b231-485d-a031-21b53f908d39&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0956538
May 25 16:49:49.582663 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-db1d10c7-5912-4c06-a234-4d0beb9c5031 req-6eab36bf-6a7f-485e-b83f-ee257ffb11fc tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Deleting port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:49:49.583005 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-db1d10c7-5912-4c06-a234-4d0beb9c5031 req-6eab36bf-6a7f-485e-b83f-ee257ffb11fc tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:49.718534 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [req-db1d10c7-5912-4c06-a234-4d0beb9c5031 req-6eab36bf-6a7f-485e-b83f-ee257ffb11fc tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] For port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f, host hv-cinder-78638, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78638',level=0,port_id=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:49:49.718942 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-db1d10c7-5912-4c06-a234-4d0beb9c5031 req-6eab36bf-6a7f-485e-b83f-ee257ffb11fc tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:49.849307 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [req-db1d10c7-5912-4c06-a234-4d0beb9c5031 req-6eab36bf-6a7f-485e-b83f-ee257ffb11fc tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Calling delete_port for f34c5bea-0865-4c2c-bcd1-2f43a4456e7f owned by compute:nova {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:49:49.967695 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-db1d10c7-5912-4c06-a234-4d0beb9c5031 req-6eab36bf-6a7f-485e-b83f-ee257ffb11fc tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:49.974726 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:49:50.024647 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eab36bf-6a7f-485e-b83f-ee257ffb11fc tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event deleted for resources: {'Port': ['ID=f34c5bea-0865-4c2c-bcd1-2f43a4456e7f,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:49:50.052080 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-6eab36bf-6a7f-485e-b83f-ee257ffb11fc tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:49:50.098383 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [req-db1d10c7-5912-4c06-a234-4d0beb9c5031 req-6eab36bf-6a7f-485e-b83f-ee257ffb11fc tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] No DVR routers for this DVR port f34c5bea-0865-4c2c-bcd1-2f43a4456e7f on host hv-cinder-78638 {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:49:50.100928 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [req-db1d10c7-5912-4c06-a234-4d0beb9c5031 req-6eab36bf-6a7f-485e-b83f-ee257ffb11fc tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for port, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:50.103556 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'name': 'network-vif-deleted', 'tag': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f'}] {{(pid=92013) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 16:49:50.116937 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-db1d10c7-5912-4c06-a234-4d0beb9c5031 req-6eab36bf-6a7f-485e-b83f-ee257ffb11fc tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.76 "DELETE /v2.0/ports/f34c5bea-0865-4c2c-bcd1-2f43a4456e7f HTTP/1.1" status: 204  len: 173 time: 0.7000246
May 25 16:49:50.154323 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6532afc0-e6bb-4fbd-bfd6-aa631fde1468', 'name': 'network-vif-deleted', 'tag': 'f34c5bea-0865-4c2c-bcd1-2f43a4456e7f', 'status': 'completed', 'code': 200}
May 25 16:49:50.714148 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-d6d3560e-449d-40cd-a146-ebcf138150e0 req-91a4aa8b-7d35-4049-a0b6-15d32fcdfff8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Synchronizing usage tracker for tenant:577d706beb414387a68972cf7e8d0285 on resource:port {{(pid=92013) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 16:49:50.729102 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.quota.resource [req-d6d3560e-449d-40cd-a146-ebcf138150e0 req-91a4aa8b-7d35-4049-a0b6-15d32fcdfff8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Unset dirty status for tenant:577d706beb414387a68972cf7e8d0285 on resource:port {{(pid=92013) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 16:49:50.730462 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [req-d6d3560e-449d-40cd-a146-ebcf138150e0 req-91a4aa8b-7d35-4049-a0b6-15d32fcdfff8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "GET /v2.0/ports?device_id=6532afc0-e6bb-4fbd-bfd6-aa631fde1468 HTTP/1.1" status: 200  len: 210 time: 0.0639093
May 25 16:49:51.829145 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33814) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:49:52.157985 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-820caed4-a384-45d4-8e97-b42a30de8e02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Deleting port 8a7ed039-17bb-4a1b-87b4-993c28f055f7 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:49:52.158333 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-820caed4-a384-45d4-8e97-b42a30de8e02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:52.275452 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-820caed4-a384-45d4-8e97-b42a30de8e02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:52.275805 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-820caed4-a384-45d4-8e97-b42a30de8e02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:52.398749 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-820caed4-a384-45d4-8e97-b42a30de8e02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Calling delete_port for 8a7ed039-17bb-4a1b-87b4-993c28f055f7 owned by network:floatingip {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:49:52.510199 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-820caed4-a384-45d4-8e97-b42a30de8e02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:52.514449 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-a530e0b5-45f6-40d1-98e7-41ef8cbec2e2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:49:52.556810 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-820caed4-a384-45d4-8e97-b42a30de8e02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event deleted for resources: {'Port': ['ID=8a7ed039-17bb-4a1b-87b4-993c28f055f7,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:49:52.586225 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-820caed4-a384-45d4-8e97-b42a30de8e02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:49:52.653535 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-820caed4-a384-45d4-8e97-b42a30de8e02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for floatingip, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:52.670503 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-820caed4-a384-45d4-8e97-b42a30de8e02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-96795'] for floatingip, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:52.671639 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-820caed4-a384-45d4-8e97-b42a30de8e02 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "DELETE /v2.0/floatingips/0c27c2b0-a5a4-4301-aeed-262ea696bb1c HTTP/1.1" status: 204  len: 168 time: 0.8409722
May 25 16:49:54.054419 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33828) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:49:54.123267 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f34990a1-68fa-4a26-8d11-4822233d95f9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:54.153102 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f34990a1-68fa-4a26-8d11-4822233d95f9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:54.215212 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f34990a1-68fa-4a26-8d11-4822233d95f9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:54.219038 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-2f08ea75-6bc1-4d6f-a571-da2d859a7ffb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:49:54.234150 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f34990a1-68fa-4a26-8d11-4822233d95f9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=63866e13-b231-485d-a031-21b53f908d39,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:49:54.237206 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-f34990a1-68fa-4a26-8d11-4822233d95f9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:49:54.244361 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-f34990a1-68fa-4a26-8d11-4822233d95f9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Notify callbacks [] for security_group, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:54.245494 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-f34990a1-68fa-4a26-8d11-4822233d95f9 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] 10.222.0.73 "DELETE /v2.0/security-groups/63866e13-b231-485d-a031-21b53f908d39 HTTP/1.1" status: 204  len: 168 time: 0.1900778
May 25 16:49:54.303218 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33834) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:49:54.486546 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device f34c5bea-0865-4c2c-bcd1-2f43a4456e7f no longer exists at agent hyperv_hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:49:54.520429 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] No Port match for: f34c5bea-0865-4c2c-bcd1-2f43a4456e7f {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:49:54.520696 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Device f34c5bea-0865-4c2c-bcd1-2f43a4456e7f not bound to the agent host hv-cinder-78638 {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:49:55.062263 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9be7f947-473a-4a51-843c-0c4c8513f999 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-501288'] for router_interface, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:55.495313 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-9be7f947-473a-4a51-843c-0c4c8513f999 admin admin] Deleting port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:49:55.496024 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9be7f947-473a-4a51-843c-0c4c8513f999 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:55.616355 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [None req-9be7f947-473a-4a51-843c-0c4c8513f999 admin admin] For port 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:49:55.616702 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9be7f947-473a-4a51-843c-0c4c8513f999 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:55.742863 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-9be7f947-473a-4a51-843c-0c4c8513f999 admin admin] Calling delete_port for 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 owned by network:router_interface {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:49:55.890403 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9be7f947-473a-4a51-843c-0c4c8513f999 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:55.893954 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-7727eff1-5457-4a63-b900-4a016ab960fa tempest-VolumesSnapshotTestJSON-197669468 tempest-VolumesSnapshotTestJSON-197669468-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:49:55.939945 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9be7f947-473a-4a51-843c-0c4c8513f999 admin admin] Pushing event deleted for resources: {'Port': ['ID=98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:49:55.942963 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9be7f947-473a-4a51-843c-0c4c8513f999 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:49:56.302145 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-9be7f947-473a-4a51-843c-0c4c8513f999 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1636838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-506040'] for router_interface, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:56.661460 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9be7f947-473a-4a51-843c-0c4c8513f999 admin admin] Router 3ec8f109-cb75-4f41-81bd-ca78638538c9 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:49:56.842255 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9be7f947-473a-4a51-843c-0c4c8513f999 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:49:56.850414 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d509e821-3859-464a-a044-530653f2f82b None None] Sync routers for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:49:56.854083 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-9be7f947-473a-4a51-843c-0c4c8513f999 admin admin] 10.222.0.73 "PUT /v2.0/routers/3ec8f109-cb75-4f41-81bd-ca78638538c9/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5497563
May 25 16:49:56.856612 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33840) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:49:56.859604 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d509e821-3859-464a-a044-530653f2f82b None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:49:56.860214 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d509e821-3859-464a-a044-530653f2f82b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346ba5bac0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:49:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:57.036039 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Notify callbacks [] for router, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:57.048204 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-d509e821-3859-464a-a044-530653f2f82b None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:49:57.217678 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:57.293202 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Deleting port 28b6c09e-dcb2-41f5-b478-f761acf64ecc {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:49:57.293583 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:57.384173 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d509e821-3859-464a-a044-530653f2f82b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346ba5bac0>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123'}], 'enable_snat': True}, 'gw_port_id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:49:55Z', 'revision_number': 5, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port': {'id': '28b6c09e-dcb2-41f5-b478-f761acf64ecc', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:0f:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 500, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:00Z', 'updated_at': '2021-05-25T16:42:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:57.387975 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d509e821-3859-464a-a044-530653f2f82b None None] Checking router: 3ec8f109-cb75-4f41-81bd-ca78638538c9 for host: dv-cinder-786386-6-iscsi {{(pid=92014) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:49:57.396826 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d509e821-3859-464a-a044-530653f2f82b None None] Routers {'3ec8f109-cb75-4f41-81bd-ca78638538c9'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92014) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:49:57.397853 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d509e821-3859-464a-a044-530653f2f82b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346ba5bac0>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:49:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['3ec8f109-cb75-4f41-81bd-ca78638538c9'], 'active': True} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:57.419032 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] For port 28b6c09e-dcb2-41f5-b478-f761acf64ecc, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=28b6c09e-dcb2-41f5-b478-f761acf64ecc,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:49:57.419392 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:57.546548 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Calling delete_port for 28b6c09e-dcb2-41f5-b478-f761acf64ecc owned by network:router_gateway {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:49:57.548378 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvr_db [None req-d509e821-3859-464a-a044-530653f2f82b None None] Set router 3ec8f109-cb75-4f41-81bd-ca78638538c9 gateway port host: None {{(pid=92014) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:49:57.655442 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_hamode_db [None req-d509e821-3859-464a-a044-530653f2f82b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346ba5bac0>, [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:49:57Z', 'revision_number': 6, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port_host': None}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92014) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:57.659799 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d509e821-3859-464a-a044-530653f2f82b None None] The sync data for ids ['3ec8f109-cb75-4f41-81bd-ca78638538c9'] in dv-cinder-786386-6-iscsi is: [{'id': '3ec8f109-cb75-4f41-81bd-ca78638538c9', 'name': 'tempest-TestVolumeBootPattern-1543553477-router', 'tenant_id': '577d706beb414387a68972cf7e8d0285', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:41:59Z', 'updated_at': '2021-05-25T16:49:57Z', 'revision_number': 6, 'project_id': '577d706beb414387a68972cf7e8d0285', 'gw_port_host': None}] {{(pid=92014) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:49:57.797956 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:57.801833 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9cdde5a3-bdbd-4277-bdc0-68934b037603 tempest-TestMinimumBasicScenario-1636855660 tempest-TestMinimumBasicScenario-1636855660-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:49:57.844165 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Pushing event deleted for resources: {'Port': ['ID=28b6c09e-dcb2-41f5-b478-f761acf64ecc,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:49:57.848204 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:49:57.936890 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-501045'] for router_gateway, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:58.113369 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-507064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2357'] for router, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:58.115594 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:58.137950 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-507780'] for router, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:58.138440 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3ec8f109-cb75-4f41-81bd-ca78638538c9 {{(pid=92013) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 16:49:58.151140 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] Notify callbacks [] for router, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:58.152235 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-b169bd8c-be62-4a6a-ae34-98fdc0123275 admin admin] 10.222.0.73 "DELETE /v2.0/routers/3ec8f109-cb75-4f41-81bd-ca78638538c9 HTTP/1.1" status: 204  len: 168 time: 1.2947364
May 25 16:49:58.154749 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33844) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:49:58.212069 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_v2 [None req-71630f8b-3dd5-46d9-93a4-7053e803b7d7 admin admin] Deleting subnet 2f2f7850-0dc5-48dc-8602-816147b64784 {{(pid=92013) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:49:58.214853 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-71630f8b-3dd5-46d9-93a4-7053e803b7d7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:58.264111 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-71630f8b-3dd5-46d9-93a4-7053e803b7d7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6928876'] for subnet, precommit_delete_associations {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:58.340103 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-71630f8b-3dd5-46d9-93a4-7053e803b7d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:58.590840 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-71630f8b-3dd5-46d9-93a4-7053e803b7d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6928756', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7156487'] for subnet, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:58.594736 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:49:58.627511 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71630f8b-3dd5-46d9-93a4-7053e803b7d7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2f2f7850-0dc5-48dc-8602-816147b64784,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:49:58.631508 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-71630f8b-3dd5-46d9-93a4-7053e803b7d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:49:58.635510 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-71630f8b-3dd5-46d9-93a4-7053e803b7d7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:58.641084 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de870197-521b-4e37-88ba-6b92f5770c4d None None] Network 9c8cc949-bd51-40a0-bff3-5527e7341361 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:49:58.641665 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-71630f8b-3dd5-46d9-93a4-7053e803b7d7 admin admin] 10.222.0.73 "DELETE /v2.0/subnets/2f2f7850-0dc5-48dc-8602-816147b64784 HTTP/1.1" status: 204  len: 168 time: 0.4857059
May 25 16:49:58.643766 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33848) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:49:58.750068 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:58.829151 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Deleting port 562728d6-bdfc-472c-a19b-dd90e3c07c82 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:49:58.830308 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:58.884525 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] DHCP port deletion for 9c8cc949-bd51-40a0-bff3-5527e7341361 request from dv-cinder-786386-6-iscsi {{(pid=92014) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 16:49:58.932883 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] For port 562728d6-bdfc-472c-a19b-dd90e3c07c82, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=562728d6-bdfc-472c-a19b-dd90e3c07c82,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:49:58.933317 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:58.951210 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Deleting port 562728d6-bdfc-472c-a19b-dd90e3c07c82 {{(pid=92014) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:49:58.951591 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:59.059775 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] For port 562728d6-bdfc-472c-a19b-dd90e3c07c82, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=562728d6-bdfc-472c-a19b-dd90e3c07c82,segment=NetworkSegment(6f90d03f-b69f-445e-ac5f-91537c20f661),segment_id=6f90d03f-b69f-445e-ac5f-91537c20f661)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:49:59.060481 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:59.066851 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Calling delete_port for 562728d6-bdfc-472c-a19b-dd90e3c07c82 owned by network:dhcp {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:49:59.114620 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:59.118463 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-32b2334c-9252-42f3-8a89-75a62af10303 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:49:59.162041 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Pushing event deleted for resources: {'Port': ['ID=562728d6-bdfc-472c-a19b-dd90e3c07c82,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:49:59.165117 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:49:59.165916 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] No DVR routers for this DVR port 562728d6-bdfc-472c-a19b-dd90e3c07c82 on host dv-cinder-786386-6-iscsi {{(pid=92013) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:49:59.182068 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Calling delete_port for 562728d6-bdfc-472c-a19b-dd90e3c07c82 owned by network:dhcp {{(pid=92014) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:49:59.225906 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244'] for port, after_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:59.229439 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:49:59.272393 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Pushing event deleted for resources: {'Port': ['ID=562728d6-bdfc-472c-a19b-dd90e3c07c82,revision_number=None']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:49:59.274673 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] No DVR routers for this DVR port 562728d6-bdfc-472c-a19b-dd90e3c07c82 on host dv-cinder-786386-6-iscsi {{(pid=92014) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:49:59.282226 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:59.282567 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:59.283716 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:59.283846 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:59.284148 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:59.284437 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:59.284758 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:59.285072 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:59.285386 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:59.286084 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:59.286084 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:59.286376 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-786386-6-iscsi {{(pid=92014) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 16:49:59.289214 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-750244e2-4b42-4639-9ee5-0ad51651af46 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:49:59.295290 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:59.308061 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346ae38ac0>,) {'filters': {'network_id': ['9c8cc949-bd51-40a0-bff3-5527e7341361']}} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:59.320115 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346ae38ac0>, '6f90d03f-b69f-445e-ac5f-91537c20f661') {'for_net_delete': True} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:59.320408 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.services.segments.db [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346ae38ac0>, '6f90d03f-b69f-445e-ac5f-91537c20f661') {} {{(pid=92013) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:49:59.332433 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6928871'] for segment, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:59.349155 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:59.355582 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Releasing vlan 435 on physical network physnet1 to pool {{(pid=92013) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:49:59.355904 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7025874'] for segment, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]: Traceback (most recent call last):
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     timer()
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     cb(*args, **kw)
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     return func(*args, **kwargs)
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     self._notify()
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     self.callback(batched_events)
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     event.method(event)
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     return f(self, *a, **k)
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self._get(url).json()
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     return self.request(url, 'GET', **kwargs)
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:49:59.372641 dv-cinder-786386-6-iscsi neutron-server[92013]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:49:59.456699 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:49:59.495357 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:49:59.495728 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 98c241a5-b7ed-4d64-8e1d-ae5a11c5f2f1 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:49:59.496132 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 28b6c09e-dcb2-41f5-b478-f761acf64ecc no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:49:59.530394 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 28b6c09e-dcb2-41f5-b478-f761acf64ecc {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:49:59.531008 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 28b6c09e-dcb2-41f5-b478-f761acf64ecc not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:49:59.531598 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 562728d6-bdfc-472c-a19b-dd90e3c07c82 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:49:59.540155 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:59.544022 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:49:59.559399 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:49:59.565663 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Pushing event deleted for resources: {'Network': ['ID=9c8cc949-bd51-40a0-bff3-5527e7341361,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:49:59.568556 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 562728d6-bdfc-472c-a19b-dd90e3c07c82 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:49:59.568910 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 562728d6-bdfc-472c-a19b-dd90e3c07c82 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:49:59.570324 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:49:59.583489 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-05aaa675-5874-48de-b988-3b8f0099948a admin admin] 10.222.0.73 "DELETE /v2.0/networks/9c8cc949-bd51-40a0-bff3-5527e7341361 HTTP/1.1" status: 204  len: 168 time: 0.9387238
May 25 16:49:59.586228 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33852) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:50:00.129346 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fee5164c-25fe-4396-acac-cd7226b3d835 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-501288'] for router_interface, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:00.529742 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-fee5164c-25fe-4396-acac-cd7226b3d835 admin admin] Deleting port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:50:00.529996 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fee5164c-25fe-4396-acac-cd7226b3d835 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:00.652870 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [None req-fee5164c-25fe-4396-acac-cd7226b3d835 admin admin] For port 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=57e8d6da-a2a8-4df1-bfc4-609a7549fc5f,segment=NetworkSegment(a832ca7e-761b-49eb-9687-0318291c7eb2),segment_id=a832ca7e-761b-49eb-9687-0318291c7eb2)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:50:00.653221 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fee5164c-25fe-4396-acac-cd7226b3d835 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:00.774603 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-fee5164c-25fe-4396-acac-cd7226b3d835 admin admin] Calling delete_port for 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f owned by network:router_interface {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:50:01.014342 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fee5164c-25fe-4396-acac-cd7226b3d835 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:01.017763 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-aa7acbb9-d1a0-4cec-9140-2daef289fda0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:50:01.060966 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fee5164c-25fe-4396-acac-cd7226b3d835 admin admin] Pushing event deleted for resources: {'Port': ['ID=57e8d6da-a2a8-4df1-bfc4-609a7549fc5f,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:50:01.064497 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-fee5164c-25fe-4396-acac-cd7226b3d835 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:50:01.328716 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-fee5164c-25fe-4396-acac-cd7226b3d835 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1636838', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-506040'] for router_interface, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:01.444416 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-1d101943-d322-40c5-98a2-33bbb8186ce2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:01.687926 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fee5164c-25fe-4396-acac-cd7226b3d835 admin admin] Router 4328317b-18e9-4036-b7d9-0b3a94388219 has already been hosted by L3 agent 9f0a09d5-ef01-450f-8504-61fe66d55cc3 {{(pid=92013) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 16:50:01.862911 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fee5164c-25fe-4396-acac-cd7226b3d835 admin admin] Notify agent at l3_agent.dv-cinder-786386-6-iscsi the message routers_updated {{(pid=92013) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 16:50:01.871300 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5a1e680-779b-467a-adc7-2d76001c11c3 None None] Sync routers for ids ['4328317b-18e9-4036-b7d9-0b3a94388219'] in dv-cinder-786386-6-iscsi {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 16:50:01.878644 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-fee5164c-25fe-4396-acac-cd7226b3d835 admin admin] 10.222.0.73 "PUT /v2.0/routers/4328317b-18e9-4036-b7d9-0b3a94388219/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.2914488
May 25 16:50:01.881207 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33856) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:50:01.881335 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5a1e680-779b-467a-adc7-2d76001c11c3 None None] Routers {'4328317b-18e9-4036-b7d9-0b3a94388219'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:50:01.881847 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-e5a1e680-779b-467a-adc7-2d76001c11c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b909340>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:49:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['4328317b-18e9-4036-b7d9-0b3a94388219'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:50:02.055417 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Notify callbacks [] for router, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:02.055646 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-e5a1e680-779b-467a-adc7-2d76001c11c3 None None] Set router 4328317b-18e9-4036-b7d9-0b3a94388219 gateway port host: dv-cinder-786386-6-iscsi {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:50:02.231463 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:02.340196 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-e5a1e680-779b-467a-adc7-2d76001c11c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b909340>, [{'id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'name': 'tempest-TestVolumeBootPattern-1857999268-router', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'external_fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249'}], 'enable_snat': True}, 'gw_port_id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:42:07Z', 'updated_at': '2021-05-25T16:50:00Z', 'revision_number': 5, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'gw_port': {'id': '9fc0f568-b8c7-404d-a3ea-aefdfddce437', 'name': '', 'network_id': 'fb2e42fa-5ca5-4bd3-bf76-6ca41e4819fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:dc:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'device_owner': 'network:router_gateway', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'ip_address': '172.27.3.249', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-786386-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:42:08Z', 'updated_at': '2021-05-25T16:42:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '772b799b-fb95-46a6-ab51-ab34127985e2', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-786386-6-iscsi'}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:50:02.344192 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5a1e680-779b-467a-adc7-2d76001c11c3 None None] Checking router: 4328317b-18e9-4036-b7d9-0b3a94388219 for host: dv-cinder-786386-6-iscsi {{(pid=92015) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 16:50:02.352810 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5a1e680-779b-467a-adc7-2d76001c11c3 None None] Routers {'4328317b-18e9-4036-b7d9-0b3a94388219'} bound to L3 agent in host dv-cinder-786386-6-iscsi {{(pid=92015) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 16:50:02.353425 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-e5a1e680-779b-467a-adc7-2d76001c11c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f346b909340>, 'dv-cinder-786386-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:29:34Z,description=<?>,heartbeat_timestamp=2021-05-25T16:49:34Z,host='dv-cinder-786386-6-iscsi',id=9f0a09d5-ef01-450f-8504-61fe66d55cc3,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T16:29:34Z,topic='l3_agent')) {'router_ids': ['4328317b-18e9-4036-b7d9-0b3a94388219'], 'active': True} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:50:02.406399 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Deleting port 9fc0f568-b8c7-404d-a3ea-aefdfddce437 {{(pid=92013) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:50:02.407023 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:02.500968 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_dvr_db [None req-e5a1e680-779b-467a-adc7-2d76001c11c3 None None] Set router 4328317b-18e9-4036-b7d9-0b3a94388219 gateway port host: None {{(pid=92015) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 16:50:02.526852 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.db [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] For port 9fc0f568-b8c7-404d-a3ea-aefdfddce437, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=9fc0f568-b8c7-404d-a3ea-aefdfddce437,segment=NetworkSegment(7eb8861e-7e01-42c3-9125-cf4be9b46f45),segment_id=7eb8861e-7e01-42c3-9125-cf4be9b46f45)] {{(pid=92013) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:50:02.527217 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:02.605275 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.l3_hamode_db [None req-e5a1e680-779b-467a-adc7-2d76001c11c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f346b909340>, [{'id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'name': 'tempest-TestVolumeBootPattern-1857999268-router', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:42:07Z', 'updated_at': '2021-05-25T16:50:02Z', 'revision_number': 6, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'gw_port_host': None}], 'dv-cinder-786386-6-iscsi', False) {} {{(pid=92015) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:50:02.609259 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5a1e680-779b-467a-adc7-2d76001c11c3 None None] The sync data for ids ['4328317b-18e9-4036-b7d9-0b3a94388219'] in dv-cinder-786386-6-iscsi is: [{'id': '4328317b-18e9-4036-b7d9-0b3a94388219', 'name': 'tempest-TestVolumeBootPattern-1857999268-router', 'tenant_id': 'd0bf591a76874ca3957c9de33c471227', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:42:07Z', 'updated_at': '2021-05-25T16:50:02Z', 'revision_number': 6, 'project_id': 'd0bf591a76874ca3957c9de33c471227', 'gw_port_host': None}] {{(pid=92015) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 16:50:02.651558 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.plugins.ml2.plugin [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Calling delete_port for 9fc0f568-b8c7-404d-a3ea-aefdfddce437 owned by network:router_gateway {{(pid=92013) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:50:02.784441 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7025799'] for port, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:02.787868 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-4aad936a-4ecf-4109-84bc-a0b939169589 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:50:02.830831 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Pushing event deleted for resources: {'Port': ['ID=9fc0f568-b8c7-404d-a3ea-aefdfddce437,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:50:02.833947 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:50:02.920551 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-501045'] for router_gateway, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:03.107390 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-507064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2357'] for router, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:03.109520 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:03.131719 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-507780'] for router, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:03.132216 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4328317b-18e9-4036-b7d9-0b3a94388219 {{(pid=92013) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 16:50:03.145152 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] Notify callbacks [] for router, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:03.148323 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-2c63e919-de3a-426e-aff6-5fb41fb3dd77 admin admin] 10.222.0.73 "DELETE /v2.0/routers/4328317b-18e9-4036-b7d9-0b3a94388219 HTTP/1.1" status: 204  len: 168 time: 1.2661834
May 25 16:50:03.150782 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33860) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:50:03.218813 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.db.db_base_plugin_v2 [None req-b4990fac-6cdb-40b9-b417-296d5a11452b admin admin] Deleting subnet 45256ccb-705d-488f-8825-5503d528ba51 {{(pid=92013) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 16:50:03.222179 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b4990fac-6cdb-40b9-b417-296d5a11452b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:03.271264 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b4990fac-6cdb-40b9-b417-296d5a11452b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6928876'] for subnet, precommit_delete_associations {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:03.349270 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b4990fac-6cdb-40b9-b417-296d5a11452b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1534919'] for subnet, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:03.464157 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:50:03.513594 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:50:03.514086 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 57e8d6da-a2a8-4df1-bfc4-609a7549fc5f not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:50:03.514563 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 9fc0f568-b8c7-404d-a3ea-aefdfddce437 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:50:03.550724 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 9fc0f568-b8c7-404d-a3ea-aefdfddce437 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:50:03.551193 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 9fc0f568-b8c7-404d-a3ea-aefdfddce437 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:50:03.613845 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b4990fac-6cdb-40b9-b417-296d5a11452b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1546098', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6928756', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-7156487'] for subnet, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:03.617874 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:50:03.652023 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4990fac-6cdb-40b9-b417-296d5a11452b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=45256ccb-705d-488f-8825-5503d528ba51,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:50:03.655138 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-b4990fac-6cdb-40b9-b417-296d5a11452b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:50:03.656812 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-b4990fac-6cdb-40b9-b417-296d5a11452b admin admin] Notify callbacks [] for subnet, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:03.661119 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-477b8e56-9b20-4479-898d-01809eb385e3 None None] Network efa74063-00d3-424c-8e6c-15db79789235 requested from dv-cinder-786386-6-iscsi {{(pid=92014) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 16:50:03.664057 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-b4990fac-6cdb-40b9-b417-296d5a11452b admin admin] 10.222.0.73 "DELETE /v2.0/subnets/45256ccb-705d-488f-8825-5503d528ba51 HTTP/1.1" status: 204  len: 168 time: 0.5079212
May 25 16:50:03.664407 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [-] (92012) accepted ('10.222.0.73', 33864) {{(pid=92012) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:50:03.771528 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1524403'] for network, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:03.849197 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Deleting port 7fff4511-d58a-4a65-958a-c586cd556f89 {{(pid=92012) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:50:03.849632 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:03.868416 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:03.901759 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2cfb3fe7-1f04-44fa-ad5c-d53a7ddc6e94 None None] DHCP port deletion for efa74063-00d3-424c-8e6c-15db79789235 request from dv-cinder-786386-6-iscsi {{(pid=92014) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 16:50:03.953662 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.db [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] For port 7fff4511-d58a-4a65-958a-c586cd556f89, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=7fff4511-d58a-4a65-958a-c586cd556f89,segment=NetworkSegment(a832ca7e-761b-49eb-9687-0318291c7eb2),segment_id=a832ca7e-761b-49eb-9687-0318291c7eb2)] {{(pid=92012) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:50:03.954052 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.004091 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-2cfb3fe7-1f04-44fa-ad5c-d53a7ddc6e94 None None] Deleting port 7fff4511-d58a-4a65-958a-c586cd556f89 {{(pid=92014) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 16:50:04.004467 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2cfb3fe7-1f04-44fa-ad5c-d53a7ddc6e94 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8741446399555'] for port, before_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.077634 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.plugin [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Calling delete_port for 7fff4511-d58a-4a65-958a-c586cd556f89 owned by network:dhcp {{(pid=92012) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:50:04.101608 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.db [None req-2cfb3fe7-1f04-44fa-ad5c-d53a7ddc6e94 None None] For port 7fff4511-d58a-4a65-958a-c586cd556f89, host dv-cinder-786386-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-786386-6-iscsi',level=0,port_id=7fff4511-d58a-4a65-958a-c586cd556f89,segment=NetworkSegment(a832ca7e-761b-49eb-9687-0318291c7eb2),segment_id=a832ca7e-761b-49eb-9687-0318291c7eb2)] {{(pid=92014) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 16:50:04.102007 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2cfb3fe7-1f04-44fa-ad5c-d53a7ddc6e94 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-500217'] for port, precommit_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.125310 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7823314'] for port, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.130100 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-c334f3bc-4f47-4725-8d95-68611c2f96f8 tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:50:04.174197 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Pushing event deleted for resources: {'Port': ['ID=7fff4511-d58a-4a65-958a-c586cd556f89,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:50:04.175995 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] No DVR routers for this DVR port 7fff4511-d58a-4a65-958a-c586cd556f89 on host dv-cinder-786386-6-iscsi {{(pid=92012) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:50:04.177543 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:50:04.234743 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-2cfb3fe7-1f04-44fa-ad5c-d53a7ddc6e94 None None] Calling delete_port for 7fff4511-d58a-4a65-958a-c586cd556f89 owned by network:dhcp {{(pid=92014) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 16:50:04.244289 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d6094d43-a6aa-4dbb-a545-76b39c5b5c92 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.280411 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-2cfb3fe7-1f04-44fa-ad5c-d53a7ddc6e94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-576476', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1974617', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1636852', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8741446402214', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8741446017244'] for port, after_delete {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.285342 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:50:04.291760 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1544776', 'neutron.services.segments.db._delete_segments_for_network-8741446462172'] for network, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.305030 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f346b297220>,) {'filters': {'network_id': ['efa74063-00d3-424c-8e6c-15db79789235']}} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:50:04.320711 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b297220>, 'a832ca7e-761b-49eb-9687-0318291c7eb2') {'for_net_delete': True} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:50:04.320999 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.services.segments.db [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f346b297220>, 'a832ca7e-761b-49eb-9687-0318291c7eb2') {} {{(pid=92012) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 16:50:04.330623 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cfb3fe7-1f04-44fa-ad5c-d53a7ddc6e94 None None] Pushing event deleted for resources: {'Port': ['ID=7fff4511-d58a-4a65-958a-c586cd556f89,revision_number=None']} {{(pid=92014) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:50:04.332550 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8741446471325', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-976068'] for segment, before_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.333576 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG oslo_concurrency.lockutils [None req-2cfb3fe7-1f04-44fa-ad5c-d53a7ddc6e94 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:50:04.334365 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cfb3fe7-1f04-44fa-ad5c-d53a7ddc6e94 None None] No DVR routers for this DVR port 7fff4511-d58a-4a65-958a-c586cd556f89 on host dv-cinder-786386-6-iscsi {{(pid=92014) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 16:50:04.349635 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168'] for segment, precommit_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.355619 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Releasing vlan 412 on physical network physnet1 to pool {{(pid=92012) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 16:50:04.355989 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1533168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7823239'] for segment, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]: Traceback (most recent call last):
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     timer()
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     cb(*args, **kw)
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     return func(*args, **kwargs)
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     self._notify()
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     self.callback(batched_events)
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     event.method(event)
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     return f(self, *a, **k)
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._get(url).json()
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     return self.request(url, 'GET', **kwargs)
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 16:50:04.369563 dv-cinder-786386-6-iscsi neutron-server[92012]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 16:50:04.442204 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1544769', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-1592119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1636847', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-501032'] for network, after_delete {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.445651 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:50:04.458823 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron_lib.callbacks.manager [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1636810'] for network, before_response {{(pid=92012) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.473166 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Pushing event deleted for resources: {'Network': ['ID=efa74063-00d3-424c-8e6c-15db79789235,revision_number=None']} {{(pid=92012) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:50:04.477375 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG oslo_concurrency.lockutils [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:50:04.480823 dv-cinder-786386-6-iscsi neutron-server[92012]: INFO neutron.wsgi [None req-d8abc6b8-963e-4999-93f9-e26e66a7de79 admin admin] 10.222.0.73 "DELETE /v2.0/networks/efa74063-00d3-424c-8e6c-15db79789235 HTTP/1.1" status: 204  len: 168 time: 0.8154426
May 25 16:50:04.593164 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33870) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:50:04.644928 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-6a9e9d3f-ea31-45f0-86f0-1875c36873ae admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=577d706beb414387a68972cf7e8d0285&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0505936
May 25 16:50:04.647247 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33874) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:50:04.703666 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bdd1656c-8871-452e-a93c-e8fee62fe716 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.730129 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bdd1656c-8871-452e-a93c-e8fee62fe716 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.781561 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bdd1656c-8871-452e-a93c-e8fee62fe716 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.785788 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-9dec71c6-5ccd-4d28-9af7-746685695daf tempest-TestVolumeBootPattern-929133162 tempest-TestVolumeBootPattern-929133162-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:50:04.799202 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdd1656c-8871-452e-a93c-e8fee62fe716 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed3ec06a-958a-41e2-9a95-bb80ff2e72fe,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:50:04.802939 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-bdd1656c-8871-452e-a93c-e8fee62fe716 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:50:04.806080 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-bdd1656c-8871-452e-a93c-e8fee62fe716 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:04.807180 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-bdd1656c-8871-452e-a93c-e8fee62fe716 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/ed3ec06a-958a-41e2-9a95-bb80ff2e72fe HTTP/1.1" status: 204  len: 168 time: 0.1590734
May 25 16:50:05.095545 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:05.150545 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33882) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:50:05.197810 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-cc3168d9-6c41-4a53-bcd8-4deed13d9057 admin admin] 10.222.0.73 "GET /v2.0/security-groups?tenant_id=d0bf591a76874ca3957c9de33c471227&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0460432
May 25 16:50:05.200222 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [-] (92013) accepted ('10.222.0.73', 33886) {{(pid=92013) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 16:50:05.349363 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-deb66c25-06ba-4866-a469-62516bd74c20 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:05.374940 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-deb66c25-06ba-4866-a469-62516bd74c20 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:05.434477 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-deb66c25-06ba-4866-a469-62516bd74c20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1592141'] for security_group, after_delete {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:05.438442 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-e08a491f-aee4-4918-95eb-1c14ae52d4af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 16:50:05.449742 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deb66c25-06ba-4866-a469-62516bd74c20 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04256e36-b9b6-4230-b204-0ce061daa0d4,revision_number=None']} {{(pid=92013) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 16:50:05.452543 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG oslo_concurrency.lockutils [None req-deb66c25-06ba-4866-a469-62516bd74c20 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92013) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 16:50:05.458797 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron_lib.callbacks.manager [None req-deb66c25-06ba-4866-a469-62516bd74c20 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92013) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:05.459891 dv-cinder-786386-6-iscsi neutron-server[92013]: INFO neutron.wsgi [None req-deb66c25-06ba-4866-a469-62516bd74c20 admin admin] 10.222.0.73 "DELETE /v2.0/security-groups/04256e36-b9b6-4230-b204-0ce061daa0d4 HTTP/1.1" status: 204  len: 168 time: 0.2587724
May 25 16:50:05.468518 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 7fff4511-d58a-4a65-958a-c586cd556f89 no longer exists at agent ovs-agent-dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 16:50:05.504610 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.plugin [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] No Port match for: 7fff4511-d58a-4a65-958a-c586cd556f89 {{(pid=92014) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 16:50:05.504865 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron.plugins.ml2.rpc [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Device 7fff4511-d58a-4a65-958a-c586cd556f89 not bound to the agent host dv-cinder-786386-6-iscsi {{(pid=92014) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 16:50:06.615324 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:08.621313 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:50:14.330915 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:31.448275 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-917bc529-d53b-48e9-a3de-ba2e65b5af34 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:33.871963 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:34.126512 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-299b5948-307d-4730-a973-f1e04f760c3a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:35.097786 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:36.618243 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:44.333545 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:50:45.620622 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:51:01.451359 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4e720137-697f-484c-833d-5fb4cb779285 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:51:03.874385 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:51:04.128205 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4278f1b7-91be-4dc0-9929-5359ddba1cd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:51:05.101646 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:51:06.619693 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:51:14.340905 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:51:22.619493 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:51:31.454648 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-4407b87e-585e-44ec-9231-808522e3b026 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:51:33.876269 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:51:34.130409 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d86b8c93-01e8-4962-ba8b-8dad935f77e8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:51:35.104922 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:51:36.622375 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:51:44.332959 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:51:59.617875 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:52:01.456005 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-92635141-1353-4954-a217-5a2d6c18cfde None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:52:03.878792 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:52:04.131040 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-5488cc16-1a1d-42f7-b603-95748b9d9281 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:52:05.107713 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:52:06.625953 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:52:14.368180 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:52:31.457344 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-00fe1c3b-4a71-4235-9efe-4af2bae3bc9b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:52:33.881835 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:52:34.132466 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-578461be-9d4c-47b6-83cc-cb1720e494b6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:52:35.111205 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:52:36.618231 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:52:36.626642 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:52:44.368990 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:52:55.379855 dv-cinder-786386-6-iscsi neutron-server[92012]: DEBUG neutron.wsgi [req-236b3aab-7713-4e7d-be34-95112447d3d9 req-780be6db-fac6-40bb-bc9f-3c5b9a2e2494 service neutron] (92012) timed out ('10.222.0.76', 57590) {{(pid=92012) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 25 16:52:58.153750 dv-cinder-786386-6-iscsi neutron-server[92013]: DEBUG neutron.wsgi [req-92e977de-e71b-44e2-8951-cf6f3418245c req-ba89293d-b4f0-4105-af16-eac3ade5f4f1 service neutron] (92013) timed out ('10.222.0.76', 57583) {{(pid=92013) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 25 16:53:01.462662 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8eb9586b-dcb0-49bc-be54-ddbcec02080f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:53:03.884443 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:53:04.134339 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d8a5ab32-7c17-4d6f-a82b-d0cb7e996084 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:53:05.115295 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:53:06.629722 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:53:13.616996 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:53:14.384835 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:53:31.466560 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-45bc615e-97bf-46d2-93b1-033480a16334 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:53:33.886373 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:53:34.134961 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c1648274-f13f-4fcf-a4be-223d20185f8d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:53:35.116791 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:53:36.633666 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:53:44.382780 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:53:50.615854 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:54:01.470763 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-7fbad697-8dec-4d44-9eb6-2727519b5398 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:54:03.888791 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:54:04.136830 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-3d319345-113b-4854-b83f-8a02cb1f0073 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:54:05.120467 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:54:06.637657 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:54:14.382165 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:54:27.616096 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:54:31.472178 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-bf952243-f2c8-490f-b96e-2d53461d72c4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:54:33.891538 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:54:34.147781 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-d436f0dd-3d4b-4226-8de6-5b61bb0e6864 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:54:35.123047 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:54:36.638920 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:54:44.381427 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:55:01.474381 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-5d049259-05e0-4fbb-b59f-a14cbb845f3b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:55:03.900987 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-c9502710-72ff-45d7-8e20-13e30e4c613c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:55:04.140160 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-f7e79853-c85c-429c-bd9d-856a87419136 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:55:04.618518 dv-cinder-786386-6-iscsi neutron-server[92015]: DEBUG neutron.db.agents_db [None req-dc534081-48f3-44af-aec4-7ff0fe1a830f None None] Agent healthcheck: found 6 active agents {{(pid=92015) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 16:55:05.125593 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-8db8c081-542f-4c92-b065-59ca213387f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:55:06.647364 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-98dc6168-e21f-4684-827e-8a92470732bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:55:14.384313 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-83c139d4-2582-422c-845a-d648b106a9ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 16:55:31.476136 dv-cinder-786386-6-iscsi neutron-server[92014]: DEBUG neutron_lib.callbacks.manager [None req-3457a024-2702-47ed-a97a-fe4a3307e363 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8741446462190', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1547142'] for agent, after_update {{(pid=92014) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}